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ABSTRACT 


The  major  difficulties  in  determination  of  the 
steady-state  properties  of  a Markovian  queuing  network  by 
numerical  solution  of  a set  of  linear  balance  equations  are 
the  choice  of  vector  representation  of  the  states,  the 
generation  and  storage  of  the  states,  and  generation, 
storage  and  sclution  of  the  balance  equations. 

Lexicographic  sequencing  of  the  vector  representations  are 
shown  in  this  thesis  to  lead  to  efficiencies  in  the  storage 
and  solution  of  the  balance  equations  and  to  provide  a key 
to  efficient  generation  and  storage  of  the  states. 
Convergence  properties  of  three  iterative  sclution  methods 
are  examined  for  cyclic  models,  such  as  those  which  can 
result  from  a central-server  model.  An  analysis  of  possible 
bias  in  software  monitors  on  computer  systems  is  analyzed  in 
terms  of  a central-server  model  of  such  systems.  Techniques 
for  examining  tape- mounting  policies  and  core-allocation 
policies  are  also  suggested. 
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I. 


INTRODUCTION 


and  LITERATURE  REVIEW 


This  first  chapter  consists  of  an  introduction,  a 
discussion  of  some  of  the  notation  and  terminology  used  in 
subsequent  chapters  and  a review  of  pertinent  literature. 

The  first  section  provides  background  information  and 
motivation  for  the  work  represented  by  this  thesis.  The 
second  section  is  a preview  of  the  remainder  of  the  thesis. 
The  third  section,  together  with  Appendix  A,  provides  the 
theoretical  background  which  justifies  development  of 
balance  equations  in  future  chapters.  The  fourth  section 
introduces  seme  of  the  notation  and  terminology  used 
throughout  the  thesis.  Although  some  of  the  chapters  may  be 
read  independently  of  each  other,  an  understanding  of  the 
material  in  the  fourth  section  is  essential  to  all  other 
chapters  with  the  possible  exception  of  Chapter  III.  The 
final  section  is  a review  of  the  literature  pertinent  to  the 
subject  or  this  thesis. 

1.  INTRODUCTION 


The  WWMCCS  Computer  Performance  Evaluation  Offi 
Command  and  Control  Technical  Center  provides  suppo 
Joint  Chiefs  of  Staff  (JC3)  in  assessing  the  capaai 
the  Worldwide  Military  Command  and  Control  System  ( 
community  to  be  responsive  to  the  needs  of  the  JCS. 
part  of  this  support  tne  WWMCCS  Computer  Performanc 
Evaluation  Office  is  responsible  for  the  developmen 
procurement  and  utilization  of  computer  performance 
evaluation  and  measurement  methodologies  to  investi 


ce  of  the 
rt  to  the 
lity  of 
WWMCCS) 

As  a 
e 
t, 

gate 


computer  system  performance  at  WWMCCS  sites.  These 
methodologies  are  also  to  be  used  to  predict  the  performance 
of  proposed  computer  systems  and  the  performance  of  existing 
computer  systems  under  differing  workloads  and  hardware 
configurations. 

One  method  available  for  attacking  such  problems  is 
essentially  trial  and  error.  A proposed  system  can  be 
assembled,  or  a proposed  change  to  an  existing  system  can  be 
made,  and  the  performance  of  the  resulting  system  measured 
and  evaluated.  This  is,  however,  a costly  approach.  Not 
only  is  the  rental  or  purchase  of  the  hardware  prohibitive 
of  such  practices,  but  also  the  installation  cost  and  time, 
and  time  spent  in  developing  and  implementing  the  required 
software,  or  changes  in  software,  must  be  considered. 

A less  costly  alternative  to  the  trial  and  error  metnod 
is  a method  in  which  performance  measurements  are  made  on  an 
already-existing  system  which  is  identical  to,  or  at  least 
quite  similar  to,  the  proposed  system.  This  is,  perhaps, 
the  best  method.  However,  it  is  often  cot  feasible.  Either 
a similar  system  does  not  exist,  or  it  is  not  possible  to 
collect  the  needed  data  from  it.  Even  when  it  is  possible 
tc  make  measurements,  the  type  of  joos  which  make  up  the 
lead  offered  to  the  existing  system  may  differ  drastically 
from  tne  type  cf  jobs  which  will  be  offered  to  the  proposed 
system.  Such  differences  in  the  job  streams  make 
conclusions  drawn  from  collected  data  suspect. 

Two  other  methods  involve  modelling  the  proposed 
computer  system  as  a network  of  queues.  Such  queuing  models 
have  been  discussed  by  Gaver  [36],  McKinney  [79],  Shedler 
[100],  a yszewianski  and  Disney  [113],  and  many  others.  Both 
analytic  techniques  and  simulation  have  been  used  as 
solution  procedures. 
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Analytic  methods  quite  often  require  rather  stringent 
assumptions  which  actual  systems  usually  do  not  satisfy.  On 
the  other  hand,  they  sometimes  have  a surprising  (and, 
unfortunately,  unpredictable)  robustness  which  allows  the 
differences  tetween  the  assumptions  and  real  life  to  be 
ignored.  Although  steady-state,  or  long-run  average, 
measures  cf  performance  are  the  most  commonly  attainable 
quantities,  transient  behavior  is  sometimes  also  derivable. 
However,  this  transient  behavior  depends  upon  starting 
conditions  which,  for  most  cases  of  interest  in  modelling  a 
computer,  are  unknown.  Fortunately,  many  potential 
problems,  most  notably  bottlenecks,  can  be  detected  using 
steady-state  measures.  (The  reader  is  referred,  for 
example,  to  Euzen  [16].) 

Simulation  models  have  the  advantage  or  providing  an 
appealing  pictorial  similarity  to  the  modelled  system.  By 
observing  the  event-by-event  occurrences  during  a 
simulation,  one  can  "watch”  jobs  progress  from  queue  to 
queue.  The  transient  behavior  of  tne  system  can  be  examined 
quite  explicitly.  However,  for  exactly  the  reasons  given  in 
the  preceding  paragraph,  the  most  useful  measures  derived 
from  a simulation  are  the  steady-state  measures. 
Unfortunately,  for  modexs  of  any  reasonable  degree  of 
complexity,  accuracy  in  these  steady-state  measures  requires 
rather  large  running  times.  (These  times  increase  at  least 
exponentially  with  complexity.)  Besides  the  running-time 
problem,  there  is  often  the  problem  of  determining  when  the 
effect  of  the  initial  conditions  has  died  out,  so  that 
collection  of  such  things  as  waiting  times  and  queue  lengths 
can  begin.  Many  simulation  models  of  networks  of  queues 
have  been  reported.  The  interested  reader  is  referred  to 
Cochi  [26],  Browne,  Lan  and  Baskett  [14],  Cheng  [24],  Saver 
and  Shedler  [41],  Lavenberg  and  Shedler  [76],  and  Querubin 
and  Ramamoorthy  [89].  This  list  of  references,  neither 
exhaustive  ncr  representative,  consists  of  examples  of 


14 


models  of  computer  systems. 


This  thesis  is  concerned  with  the  problems  associated 
with  development  and  numerical  solution  of  analytic  models. 
Therefore,  reference  will  seldom  be  made  to  simulation 
efforts  such  as  those  cited  above.  The  analytic  method 
utilized  throughout  this  thesis  is  an  embedded  Markov  chain 
approach  which  leads  to  a system  of  linear  balance 
equations.  These  equations  can  be  solved  for  the 
steady-state  probability  of  finding  the  system  in  eacn 
state.  Appropriate  weighted  averages  of  these  steady-state 
probabilities  tnen  reveal  the  desired  measures  of  system 
performance.  (See  Kendall  [65]  for  a discussion  of  this 
technique.)  This  technique  has  proved  to  be  the  most 
fruitful  method  available  for  deriving  numerical  results  for 
queuing  problems.  Many  of  the  references  cited  in  the 
remainder  of  this  chapter  make  use  of  this  technique. 

Another  method,  one  which  will  not  be  pursued  here,  is 
the  use  of  diffusion  approximations.  The  reader  who  is 
interested  in  the  application  of  diffusion  techniques  to 
queuing  networks  is  referred  to  Gaver  [37],  Gaver  and 
Shedler  [42],  Gelenbe  [45],  Kobayashi  [72,73]  and  Reiser  and 
Kobayashi  [94], 

In  the  simplest  of  queuing  models,  a state  can  be 
conveniently  represented  by  a single  number.  For  example, 
consider  a single  queue  having  finite  capacity,  N.  Any 
customer,  or  job,  arriving  at  a time  when  there  are  N jobs 
at  the  queue,  enqueued  and  in  service,  is  immediately  turned 
away  and  lost  to  the  system.  Tne  states  of  the  system  are 
conveniently  numbered  0,  1,  2,  ...»  N,  where  the  number  of 
each  state  is  the  number  of  jobs  at  the  queue  when  the 
system  is  in  that  state. 

As  the  complexity  of  the  model  increases  (for  example. 
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more  queues,  different  job  types,  more  complicated  arrival 
and  service  schemes),  so  does  the  complexity  of  the  state 
description  and  usually  the  number  of  states.  A vector 
representation  is  a necessary  state  description  in  many  of 
these  more  complicated  cases.  Many  examples  will  be  given 
in  Chapter  II.  Also,  many  of  the  references  cited  in  the 
final  section  of  this  chapter  use  vector  representations. 
However,  the  use  of  a vector  representation  produces  severe 
complications  in  solution  procedures.  For  example,  how  can 
consideration  of  all  states  without  possible  duplication  be 
made?  When  using  a computer  to  arrive  at  a solution 
(usually  a necessity  as  the  state  spaces  become  large)  , how 
can  the  state  descriptions  and  the  balance  equations  be 
efficiently  stored? 


2.  PREVIEW  OF  THE  THESIS 


In  recent  years  the  discovery  of  whav  has  come  to  be 
called  a prcduct-form  solution  for  certain  classes  of 
problems  (see  subsection  5.3)  has  greatly  simplified  the 
solution  of  such  problems  by  making  it  unnecessary  to  store 
and  solve  the  balance  equations.  For  example,  if  A is  any 
state,  then  the  steady-state  probability  of  finding  the 
system  in  state  A is  found  to  be 


(1.1)  P (A)  = C TT  f.  (A) 

1 


where  C is  a normalization  constant,  the  product  runs  from  i 

= 1 to  i * the  number  of  queues,  and  f is  dependent  upon 

i 

the  system  parameters  and  the  character  of  the  job  stream  at 


queue  i,  but  not  upon  A in  any  other  way.  Note  that  it  is 
still  necessary  to  be  able  to  consider  all  of  the  states 
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without  duplication 


A large  class  cf  problems  are  not  known  to  have  a 
prcduct  fcrm  solution  (or  some  other  simple  solution  form) . 
These  are  considered  by  many  to  be  unwieldy  because  of  the 
type  of  analytic  complications  mentioned  above.  In  Chapter 
II  the  complications  resulting  from  vector  representations 
are  addressed  and  techniques  are  presented  for  finding 
numerical  solutions  for  a wide  variety  of  cases. 

As  previously  remarked,  the  primary  motivation  behind 
this  thesis  involves  modelling  of  multiprogramming  computer 
systems  as  networks  of  queues.  Although  many  of  the 
techniques  discussed  here  are  applicable  to  a more  general 
class  of  network  models,  the  emphasis  is  upon  the 
central-server  models  (see  Figure  1.1) , of  which  Baskett  and 
Palacios  £7]  have  said 

"The  central  server  queuing  model  seems  to  be  an 
excellent  model  of  multiprogramming  even  though 
the  assumptions  appear  to  be  violated..." 

The  physical  properties  of  a modern  computer  system 
limit  the  number  of  jobs  which  can  be  considered  for 
processing  at  any  given  moment.  Thus,  even  though  there  may 
oe  many  jcbs  waiting  for  processing  in  an  external  "input 
queue,"  the  computer  itself  might  appropriately  be  modelled 
as  a closed  network  of  queues. 

Given  such  a model,  the  Markov  chain  approach  discussed 
in  the  next  section  can  only  be  applied  if  a state  space  can 
be  discovered  such  that  the  time  between  transitions  among 
the  states  is  exponentially  distributed  with  a parameter 
which  depends  only  upon  the  state  the  system  is  in  during 
that  time.  Using  vectors  as  state  descriptors  leads  to  such 
state  spaces  for  a large  class  of  models.  Examples  of 
vector  state  spaces  used  in  this  manner  are  found  in  many  of 
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the  references  given  in  this  chapter,  as  well  as  throughout 
the  thesis.  Once  a state  space  has  been  determined,  it  is  a 
relatively  routine  matter  to  write  down  the  balance 
equations  resulting  from  the  Markovian  assumptions.  In 
principle  the  balance  equations  may  then  be  solved  for  the 
steady-state  probability  associated  with  each  state,  and 
composite  measures  of  system  performance  may  be  calculated 
by  taking  weighted  sums  of  the  state  probabilities. 


However,  the  complexity  of  many  interesting  models 
results  in  a state  space  whose  size  precludes  "by-hand" 
solution.  In  solving  such  problems  on  a high-speed  digital 
computer,  consideration  must  be  given  to  the  questions  of 
representation,  generation  and  storage  of  the  states  and  the 
balance  equations,  as  well  as  to  the  solution  of  the  balance 
equations . 


The  representation,  generation  and  storage  problems  are 
addressed  in  Chapter  II  for  a wide  class  of  models  for  which 
a product-fora  solution  (or  some  other  simple  solution  form) 
is  not  kncwn  to  exist.  Each  of  these  problems  is  considered 
first  for  a relatively  simple  central-server  model  (see 
Figure  1.1)  with  a single  f irst-come-f irst-served 
exponential  server  at  each  queue  and  with  two  job  types 
circulating  among  the  queues.  The  changes  necessitated  by 
various  changes  in  the  model  are  then  discussed.  The  model 
changes  considered  include  introduction  of  generalized 
Erlangian  service  distributions,  different  queuing 
disciplines,  multiple  servers  and  capacities  resulting  in 
blocking  (see  section  4 of  this  chapter)  . 

Methods  for  numerical  solution  of  the  balance  equations 
are  considered  in  Chapter  III.  In  this  chapter  the  cyclic 
nature  of  many  problems  is  exploited. 

Chapter  17  reports  on  three  computer  programs  which  nave 
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been  written  using  the  methodology  discussed  in  Chapters  II 
and  III.  This  chapter  also  contains  numerical  results 
obtained  ty  running  these  programs.  These  results  may  be 
used  to  compare  the  three  models  to  each  other  as  well  as  to 
a numerical  example  solved  (using  a product-form  solution) 
by  Baskett,  Chandy,  Muntz  and  Palacios  [6].  Suggestions  for 
approximating  the  models  programmed  by  models  which  are 
amenable  to  a product-form  solution  may  be  tested  using 
these  programs.  Some  suggestions  of  this  type  are  explored. 

Chapter  V discusses  a potential  problem  in  gathering 
data  on  an  actual  computer  system  for  comparison  with  the 
results  of  an  analytic  model.  Certain  data  gathering 
tecnnigues  are  found  to  be  biased.  Methods  for  estimating 
the  biased  results  of  these  techniques  using  the  results  of 
the  analytic  model  are  discussed. 

In  Chapter  VI  application  of  the  work  of  Courtois  [27] 
and  otners  in  decomposition  of  networks  of  queues  is 
discussed  for  models  which  contain  a central-server  network 
as  a submodel.  In  particular,  the  potential  usefulness  of 
solutions  for  the  central-server  submodel,  as  arrived  at 
using  either  a product-form  solution  procedure  or  the 
techniques  discussed  in  Chapters  II  and  III,  are  considered. 
Two  applications  are  discussed. 

Finally,  Chapter  VII  summarizes  the  results  of  the 
earlier  chapters  and  considers  open  questions  and  areas 
where  further  research  needs  to  be  done. 

Before  proceeding  with  Chapter  II,  some  of  the  concepts 
associated  with  the  Markov  chain  approach  to  gueuing  network 
problems,  as  well  as  the  major  breakthroughs  in  applying 
this  approach,  are  reviewed.  By  pointing  out  where  these 
breaktnr oughs  cannot  be  applied,  particular  areas  which 
require  the  techniques  developed  in  Chapters  II  and  III  are 
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revealed.  The  next  section  deals  with  the  Markov  chain 
approach.  Section  4 discusses  the  generalizations  used  in 
Chapter  II  as  well  as  several  of  the  references.  The  final 
section  outlines  the  history  of  developments  in  solving 
Markovian  queuing  network  problems  and  discusses  the  major 
breakthroughs. 

3.  TdE  M ABKC V CHAIN  APPROACH 

Networks  of  queues  are  generally  classified  as  either 

open  or  closed.  A closed  network  of  queues  is  a collection 

of  queues  interconnected  with  a collection  of  paths.  A 

fixed  number  of  jobs,  or  customers,  circulate  among  the 

queues  along  the  paths.  An  example  of  such  a network  is 

represented  in  Figure  1.1.  Upon  completing  service  at  one 

of  the  queues  on  the  right  (labelled  Q , Q , ...,  Q ) , a job 

1 2 M 

progresses  tc  the  queue  on  the  left,  Q . Upon  completion 

M+  1 

of  service  at  Q , the  joo  progresses  to  Q with 
M+1  1 

probability  p^,  to  with  probability  p^ , and  so  forth. 
Since  the  number  of  jobs  circulating  among  the  queues  is 

fixed,  p ♦ p +...  +p  =1. 

1 2 M 

An  open  network  of  queues  is  similar  to  a closed  network 

except  that  jobs  can  enter  the  network  and  depart  from  the 

network.  Thus,  the  number  of  jobs  need  not  be  fixed.  An 

example  of  such  a network  is  represented  in  Figure  1.2.  In 

this  example  jobs  can  enter  the  network  at  any  queue  and 

depart  the  network  from  any  queue.  Upon  completion  of 

service  at  Q , for  i = 1,  2,  a,  a job  will  proceed  to 

i 
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r — ^ 

1 


Q with  probability  q or  will  leave  the  system  with 
M + 1 il 

probability  q = 1 - q Similarly,  from  Q a job  will 

i2  il  M+1 

proceed  to  Q with  probability  p or  will  leave  the  system 
i i 

with  probability  p =1-p  - ...  - p . 

M+1  1 M 

The  models  depicted  in  Figures  1.1  and  1.2  are  called 

central- server  models,  Q being  called  the  central  server. 

M + 1 

This  thesis  will  concentrate  on  applications  of 
central-server  models  for  which  the  central  server 
represents  a central  processing  unit  (CPU),  and  the  other 
servers,  or  queues,  represent  peripheral  units  (PP's),  such 
as  tape  drives,  disc  drives,  and  so  forth. 

Consider  now  an  arbitrary  network  of  M queues.  Suppose 

that  a state  space  S has  been  chosen  as  descriptive  of  the 

possible  states  in  which  the  system  may  be  found  as  jobs 

(possibly)  enter  the  system,  move  from  queue  to  queue  and 

(possibly)  leave  the  system.  Suppose  further  that  S is 

discrete  in  the  sense  that  the  system  remains  in  any  state  i 

in  S for  a positive  time  T before  entering  another  state. 

i 

(That  is,  let  T be  the  length  of  time  from  transition  into 
i 

state  i to  the  next  transition  out  of  state  i.  Then  F (0+) 

i 

= 0 where  F (t)  is  tne  distribution  function  of  the  random 
i 

variable  T .)  If  the  distribution  of  T depends  only  upon 
i i 

the  state  i of  the  system  during  the  time  period,  and  if  the 
probability  q that  from  state  i the  system  will  next  enter 

ij 

state  j depends  only  on  the  states  i and  j,  then  the  process 
is  a semi-Markov  process  and  a Markov  chain  is  embedded  in 
it.  In  this  case,  the  future  of  the  process  is  independent 
of  the  past  if  the  current  state  of  tae  system  and  the  time 
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the  system  has  been  in  that  state  are  both  known.  The  time 
since  the  last  transition  is  necessary,  in  general,  since 
the  time  until  the  next  transition  is  a "residual  life"  and, 
therefore,  not  independent  of  the  time  since  the  last 
transition. 

However,  if  T is  distributed  exponentially,  the  time 
i 

until  the  next  transition  is  distributed  identically  with  T 

i 

(given  the  system  is  in  state  i)  and  is  independent  of  the 
length  of  tine  the  system  has  been  in  that  state.  In  this 
case  the  process  is  a Markov  process.  The  Komolgorov 
differential  equations  lead  (assuming  the  existence  of  a 
steady-state  distribution)  to  a system  of  linear  balance 
equations  of  the  form: 

(1.2)  C.E.  = 7 c.q  P 

i 1 3 ji  j 

where,  for  each  i in  S,  P is  the  steady-state  probability 

i 

that  the  system  is  in  state  i.  (Note  that  there  is  an 

implicit  assumption  here  that  S has  at  most  countably  many 
elements.  Otherwise,  the  sum  is  not  well-defined.  In  most 
queuing  applications  exponential  service  times  will 
guarantee  countability  of  s.)  An  outline  of  the  theoretical 
considerations  leading  to  the  development  of  such  balance 
equations  is  given  in  Appendix  A. 

Explicit  examples  of  how  a state  space  S may  be  chcsen 

in  order  to  ensure  that  the  times  between  transitions  are 

exponentially  distributed  will  be  given  throughout  this 

thesis.  In  most  cases  the  proper  choice  for  the  c 's  and 

i 

q 's  for  use  in  (1.2)  will  be  discussed. 

ij 
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4 


GENERALIZATIONS  FOR  USE  IN  CHAPTER  II 


In  this  section  the  generalizations  used  in  Chapte 
are  introduced.  These  include  the  generalizations  of 
service  distributions  in  subsection  4.1,  the  queuing 
disciplines  in  subsection  4.2,  the  number  of  servers  a 
single  queue  in  subsection  4.3  and  the  capacity  of  gue 
subsection  4.4  The  definitions  in  this  section  are 
essential  tc  a proper  understanding  of  the  remainder  o 
thesis. 


4.1.  Generalized  Erlang ian  S ervice  Distributions 


At  first  glance  it  may  appear  as  though  the  de 
to  find  state  spaces  which  ensure  exponential  times  be 
transitions  will  force  the  exclusive  use  of  exponentia 
service  distributions  and  Poisson  arrival  processes. 
However,  the  method  of  stages  as  introduced  by  Erlang 
and  extended  by  Jensen  [60]  and  Cox  [28]  provides  the 
opportunity  to  use  a class  of  non-exponential  distribu 
with  widely  varying  properties. 

Erlang  suggested  the  use  of,  say,  Ic  stages  of 
service  life,  with  the  times  spent  in  each  stage  havin 
independent  identical  exponential  distribution  with  ra 
parameter  c.  The  distribution  of  the  resulting  servic 
times  has  come  to  be  called  an  Erlang  distribution  wit 
parameter  c and  shape  parameter  k.  It  is  proportional 
Chi-sguared  distribution  with  2k  degrees  of  freedom. 


network 


Such 

such 


a distribution  is  generated  by 
as  that  depicted  in  Figure  1.3 
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service  at  the  first  stage  (Q  ) , immediately  proceeds  to  the 


second  stage  (Q^)  for  further  service,  and  so  forth  through 

the  k— t h stage  (Q  ) . The  service  received  in  each  stage  is 

k 

distributed  exponentially  with  rate  parameter  c.  The  total 

service  time  fcr  the  job  is  measured  from  the  time  it  enters 
the  first  stage  until  it  leaves  the  last  stage. 

From  Figure  1.3  it  may  appear  as  though,  in  a 
network  cf  queues,  each  queue  with  Erlangian  servers  cculd 
be  replaced  by  a series  of  queues  having  exponential 
servers.  However,  doing  so  could  be  misleading.  For 
example,  consider  Figure  1.3  as  depicting  a network  of  k 
queues,  and  suppose  that  there  are  m jobs  in  the  network. 
Then,  in  general,  the  m jobs  could  be  distributed  among  the 
k queues  in  any  manner  whatsoever,  and  there  would  be  a job 
(possibly  more  than  one)  in  service  at  each  queue  which  is 
not  empty.  Now  consider  Figure  1.3  as  a representation  of 
the  k stages  cf  an  Erlang  service  distribution  at  a given 
queue.  Suppose  that  the  given  queue  contains  m jobs.  If 
the  queue  has  only  one  server,  then  only  one  of  the  m jobs 
can  be  in  service.  Although  the  job  in  service  can  be  in 
any  of  the  k stages,  the  other  m - 1 jobs  must  be  awaiting 
service  at  the  first  stage  (Q^).  Thus,  it  is  possible  to 

have  at  most  one  job  among  the  < - 1 staces  Q to  Q , and  if 

2 k 

there  is  ere  among  these  stages,  then  there  can  be  no  job  in 

service  at  Q . This  is  a definite  contrast  to  the  network 

1 

of  k queues  represented  by  Figure  1.3. 

expansion  of  a queuing  network  to  include  the  stages 
of  service  at  each  queue  having  an  Erlang  service 
distribution  can  cause  complications.  These  complications 
are  unnecessary  since  all  that  is  required  is  that  the  stage 


j 
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of  service  for  each  job  experiencing  an  Erlang  service  time 
be  included  in  the  description  of  any  state. 

Example  1.1 

Consider  a network  consisting  of  a single  gueue  with 
a single  exponential  server  and  a Poisson  arrival  process 
(i.e.,  the  classical  M/M/1  queue) . Then  the  states  of  the 
system  can  be  represented  by  the  nonnegaiive  integers.  That 
is,  if  S (t)  is  the  state  of  the  system  at  time  t,  the 
possible  values  for  S (t)  are  the  nonnegative  integers:  0, 

1,  2,  ...,  where  5 (t)  = i means  that  there  are  i jots  in  the 

queue  at  time  t.  (If  i > 0,  exactly  one-  of  these  jobs  is  in 

service.)  Note  that  after  being  in  state  i for  an 
exponentially  distributed  time,  the  system  will  enter  either 
state  i - 1 (if  i * 0)  or  state  i + 1. 

Now  suppose  that  instead  of  exponential  service,  jots 
at  the  queue  experience  Erlang  service  with  shape  parameter 
k = 2.  Then  the  state  of  the  system  at  time  t can  be 

described  by  a pair  of  integers  S (t)  = {i,j}  where  i = 0,  1, 

2,  ...  represents  the  number  of  jobs  in  the  queue  and  j = 

1,  2 represents  the  stage  of  service  of  the  jco  in  service. 
If  i = 0,  let  j = 1 by  convention.  Then  the  possible  states 
of  the  system  are:  {0,1},  {1,1},  {1,2},  {2,1},  {2,2}, 

{3,1},  ...  If  S (t ) = {0,1},  then  after  an  exponentially 
distributed  length  of  time  the  system  will  transition  into 
state  {1,1}.  If  S (t)  = {i , 1 } for  i # 0,  th*n  after  an 
exponentially  distributed  length  of  time  the  system  will 
transition  either  to  state  {i+1,1},  by  having  another  job 
arrive,  cr  to  state  {i,2},  by  having  the  job  in  service 
"complete  the  first  stage  of  service  and  enter  the  second 
stage."  Similarly,  if  S (t)  = {i,2}  for  i * 0,  then  after  an 

exponentially  distributed  length  of  time  the  system  will 
transition  either  into  state  {1-1,1} , by  having  the  jot  in 
service  complete  service  and  leave  the  system,  or  into  state 
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{i+1,2},  by  having  another  job  arrive. 

Now  suppose  that  tne  service  distribution  is 
exponential  but  tnat  the  interarrival  times  have  an  Erlang 
distribution  with  shape  parameter  k = 2.  Then  the  state  of 
the  system  at  time  t can  be  represented  by  a pair  of 
integers  S (t)  = {i,j},  where  i = 0,  1,  2,  ...  represents  the 
number  of  jots  at  the  gueue  and  j = 1,  2 represents  the 
stage  of  interarri vai.  This  is  most  easily  visualized  as  a 
two  gueue  series  network  in  which  the  first  gueue  always 
contains  an  infinite  number  of  jobs  and  has  a single 
twc-stage  Erlang  server.  The  second  gueue  is  the  gueue  of 
the  original  system  and  has  a single  exponential  server. 
Since  the  number  of  jobs  at  the  first  gueue  never  changes, 
there  is  no  need  to  include  this  number  in  a state 
description.  However,  since  there  are  two  stages  in  the 
service  distribution  at  this  first  gueue,  any  state 
description  should  indicate  the  stage  of  service  of  the  job 
in  service  there.  This  is  what  is  represented  by  the  second 
component  of  the  proposed  state  description.  The  possible 
states  are:  {0,1},  {0,2},  (1,1},  {1,2},  {2,1},  ...  From 

state  S ( t)  = {0,1},  the  system  will  transition  after  an 
exponentially  distributed  length  of  tine  to  state  {0,2}. 

From  state  {0,2},  the  system  will  transition  after  ar. 
exponentially  distributed  length  of  time  to  state  {1,1}. 

This  last  transition  corresponds  to  arrival  of  a job  at  the 
original  gueue.  From  state  { i , 1 } with  i *■  0,  the  system 
will  transition  after  an  exponentially  distributed  length  of 
time  either  to  {i,2},  by  having  the  interarrival  time  enter 
the  second  stage,  or  to  {i— 1,1},  by  having  the  job  in 
service  at  the  (original)  gueue  complete  service  and  leave 
the  system.  Similarly,  from  state  {i,2}  with  i * 0,  the 
system  will  transition  after  a exponentially  distributed 
length  of  time  to  either  {i+1,1},  by  having  another  job 
arrive  at  the  gueue,  or  { i— 1 ,2} , by  having  the  job  in 
service  at  the  gueue  complete  service  and  leave  the  system. 

The  case  in  which  both  the  service  distribution  and  the 


29 


1 


interarrival  distribution  have  Erlang  distributions  requires 
a three-ccmpcnent  state  descriptor.  Two  components  are  for 
the  stage  of  the  service  distribution  and  the  interarrival 
distribution,  and  the  other  component  is  for  the  number  of 
jobs  at  the  queue. 

The  conclusion  that  the  times  between  transitions 
are  exponentially  distributed  in  Example  1.1  is  based  upon 
the  well-kncwn  fact  that  the  minimum  of  two  (or  more) 
exponential  random  variables  is  exponentially  distributed 
with  rate  parameter  which  is  equal  to  the  sum  of  the  rate 
parameters  of  the  distributions  of  the  two  random  variables. 
(This  is  easily  proved  using  standard  probabilistic 
techniques.  It  is  done,  though  not  pointed  out,  in  Earlow 
and  ProshaD  [4].  It  is  done  for  the  case  that  the  random 
variables  are  independent  and  identically  distributed  in 
Johnson  and  Kotz  [61].)  Note  that,  even  in  the  simple  cases 
discussed  in  Example  1.1,  the  rate  parameter  of  tne 
distribution  of  time  between  transitions  depends  upon  the 
state  of  the  system  during  that  time — at  least  up  to  whether 
or  not  there  is  a job  at  the  queue. 

Jensen  [60]  discussed  a generalization  of  tne  method 

of  stages  in  which  the  rate  parameters  are  allowed  to  vary 

from  stage  to  stage.  Referring  again  to  Figure  1.3,  this 

involves  allowing  c * c for  i * j,  where  the  distribution 

i 3 

of  service  at  stage  i is  exponential  with  rate  parameter  c . 

i 

Cox  [28]  carried  tne  method  of  stages  to  its 
ultimate  by  showing  that  any  life-time  random  variable  whose 
moment  generating  function  is  a ratio  of  polynomials  can  be 
modelled  as  a network  of  exponential  stages  as  depicted  in 
Figure  1.4.  (X  is  a life-time  random  variable  if  Prob  (X>0) 

= 1.)  In  Figure  1.4  a job  experiences  a zero  service  time 
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Figure  1.4--Network  Representation  of  a Generalized  Erlangian  Distribution 


For  j < k - 1,  a job 


(nc  service)  with  probability  1 - p^ . 
experiences  exactly  j stages  of  service  (each  of  which  is 

exponentially  distributed  with  possibly  different  rate 

parameters)  with  probability  p p ...p  (1-p  ).  A job 

12  j j+1 

experiences  all  k stages  of  service  with  probability 


How  let  X be  a life-tiae  random  variable  having 
distribution  function  F(x)  and  density  (if  it  exists)  f(x). 
Then  the  moment  generating  function  of  X is  the 
Laplace-Stielt jes  transform  of  F(x): 


(1.3) 


J—  s X 

e dF  (x) 


or,  if  the  density  function  exists,  the  Laplace  transform  of 
f (*)  : 


(1.4) 


F*  (s) 


f (x) ax 


(If  f(x)  exists,  the  two  integrals  are  identical.)  F*  (s)  is 
said  to  be  a rational  function  if  it  is  the  ratio  of  two 
polynomials  in  s.  The  fact  that  F (x)  is  the  distribution 
function  of  a life-tiae  random  variable  forces  the  degree  of 
the  polynomial  in  the  numerator  to  be  no  larger  than  the 
degree,  say  k,  of  the  polynomial  in  the  denominator.  As  a 
result,  F*  (s)  can  be  expanded  in  partial  fractions  as: 


(1.5)  F (s)  = (1-p  ) + 2 P,P  • • • p . (1-p.  ) TTc  /(c.+s) 

1 , 1 2 i 1+1  g g 

i=1  g=1 

where  p =0,  and  where  c , c , ...,  c are  the  k roots  of 

k+1  12k 
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the  polynomial  in  the  denominator  of  F*(s).  The  moment 
generating  function  of  a random  variable  having  the 

-cx 

exponential  distribution  function,  G (x)  = 1-e  , is: 

(1.6)  G*  (s)  = c/(c+s) 

As  a result,  (1.5)  is  found  to  be  the  moment  generating 

function  of  a random  variaole  whose  distribution  can  be 

depicted  in  Figure  1.4  with  exponentially  distributed 

stages.  In  particular,  the  distribution  at  stage  Q is 

i 

exponential  with  rate  parameter  c . 


Note  that  since,  in  general,  a tc-degree  polynomial 

cannot  be  guaranteed  to  have  all  of  its  roots  on  the 

negative  real  axis,  it  is  conceivable  that  life-time  random 

variables  exist  whose  moment  generating  functions  are  given 

by  (1.5)  with  complex  valued  p 's  and  c 's.  Indeed,  Cox 

i i 

gives  the  following  example  in  which  two  of  the  c 's  are 

i 


complex. 


Example  1.2 


Consider  a life-time  random  variable  X with 
probability  density  function 

22  2 -ax 

(1.7)  f(x)  = [a(a  +b  ) /b  ] e (1-cos  bx) 

for  x > 0 and  f(x)  = 0 for  x < 0.  Then  the  moment 
generating  function  of  X is 


2 2 2 
F*(s)  = [ a (a  ♦ b ) ] / { (a  + s ) [ (a«-s)  ♦ 


j3 


(1.3) 


2 

b ]} 


which  is  in  the  general  form  given  in  (1.5)  with  p^  = p^  = 

= 1.  Note  that  the  denominator  of  F*(s)  has  two  complex 
roots,  a+ti  and  a-bi. 

In  commenting  on  the  use  of  complex  probabilities, 
Cox  points  out  that  the  decomposition  into  stages  is  an 
artificiality,  and  that  there  is  no  real  concern  about  the 
probabilities  and  rates  connected  with  the  individual 
stages.  The  concern  is  rather  about  the  process  as  a wnole. 
That  is,  Erob{X  < x]  is  a real  probability  even  though  the 
the  probability  of  X "lasting”  two  but  not  three  stages  may 
formally  be  complex. 

Nonetheless,  the  use  of  the  method  of  stages  with 

complex  rates  and  probabilities  leads  to  complex 

coefficients  in  the  balance  equations  (see  equations  (1.2)) 

even  though  the  variables,  the  steady-state  probabilities, 

are  assumed  to  be  real  numbers  between  zero  and  one.  Huch 

of  the  numerical  analysis  presented  in  Chapter  III  of  this 

thesis  reguires  real  positive  rates  and  nonnegative  p 's. 

i 

For  this  reason  a tacit  assumption  will  persist  throughout 

that  the  c 's  are  real  and  positive  and  that  the  d 's  are 
i ‘ i 

probabilities.  To  wit,  the  definition: 

A random  variable  X is  said  to  have  a qe neralized 

Srlarqjan  distribution  if  it  can  be  represented  as 

a series  of  stages  as  depicted  in  Figure  1.4  with 

p = 1,  0 < p <1  for  i = 2,  3,  ...,  k,  and  the 
1 i 

holding  time  at  stage  Q exponentially  distributed 

i 

with  rate  c >0  for  i = 1,  2,  ...»  k. 
i 

(The  restriction  p = 1 avoids  zero  service  times.) 
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Several  other  representations  of  service  times  in 
terms  of  exponential  stages  are  possible.  A "parallel 
stages"  representation,  as  depicted  in  Figure  1.5,  is  one 
example.  (Ccx  mentions  that  this  case  is  also  derivable  in 
terms  of  a rational  moment  generating  function  so  long  as 
the  roots  of  the  denominator  polynomial,  or  equivalently, 
the  rates  of  the  exponential  stages,  are  distinct.)  Another 
series  representation  would  allow  the  service  time  to  begin 
in  any  stage  (see  Figure  1.6).  Still  another  representation 
would  allow  "movement"  from  any  stage  to  any  other  stage. 

Cox  shows  that  this  last  case  is  equivalent  to  the  case 
considered  in  Figure  1.4  with  the  c 's  and  p.'s 


appropriately  redefined. 


Although  any  of  these  alternative  representations 
could  be  considered  as  easily  as  the  one  defined  above,  only 
the  cases  covered  by  the  definition  given  will  be  explicitly 
considered  in  this  thesis.  The  reason  for  this  is 
threefold.  First,  distributions  as  depicted  in  Figure  1.4 
have  been  considered  by  other  authors.  (See  Baskett  [5], 
Baskett,  Chandy,  Muntz  and  Palacios  [6],  Litzler  and  Womack 
[78]  and  Moore  [81].)  Second,  considering  a variety  of 
representations  cannot  add  clarity  to  the  discussion  of 
generalized  Erlangian  service  distributions  later  in  this 
thesis.  And  third,  once  the  development  of  the  balance 
equations  has  been  mastered  for  the  present  case,  extension 
to  these  ether  representations  is  straightforward. 


4.2.  Queuing  Disciplines 


An  important  property  of  each  queue  is  its  queuing 
discipline;  that  is,  the  rule  or  set  of  rules  which 
determine  the  order  in  which  arriving  jobs  are  served.  The 
queues  encountered  by  people  in  their  daily  lives  usually 
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Figure  1 . 5- -Parallel  Network  Representation  of  a 
Generalized  Erlangian  Distribution 
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have  some  variation  or  the  f irst-come-f irst-served  queuing 
discipline  discussed  here.  In  such  queues  it  is  often 
impractical  or  imprudent  to  depart  too  far  from  such  a 
queuing  discipline. 

Bcwever,  quite  a variety  of  queuing  disciplines  are 
feasible  for  use  at  the  processing  units  of  a high  speed 
multiprogrammed  computer  system.  For  this  reason  much  work, 
both  theoretical  and  empirical,  has  been  undertaken  in  an 
effort  to  determine  the  relative  advantages  and 
disadvantages  of  various  queuing  disciplines.  No  attempt  is 
made  here  to  review  the  literature  in  this  area.  The 
interested  reader  is  referred  to  Kleinrock,  Muntz  and  Hsu 
[71],  Litzler  and  Womack  [78]  and  Sherman,  Baskett  and 
Brcwne  [101].  In  this  subsection  the  queuing  disciplines  to 
be  studied  in  Chapter  II  are  introduced. 

At  a queue  having  a f irst -come -fir st- served  queuing 
discipline  (hereafter  referred  to  as  FCFS ) , the  arriving 
jets  enter  service  in  the  same  order  that  they  arrive  at  the 
queue.  Cne  of  the  best  examples  of  a FCFS  queue  is  the 
check-out  counter  at  an  old  ma-and-pa  corner  grocery. 
Ignoring  the  lane  switching  phenomena,  the  check-out 
counters  cf  a modern  grocery  store  form  a parallel 
connection  cf  FCFS  queues.  A customer  joins  one  of  the 
lines  and  awaits  his  or  her  turn  to  check  out. 

At  a queue  having  a last-come-fxrst- served  queuing 
discipline  (hereafter  referred  to  as  LCFS) , an  available 
server  always  serves  the  job  which  has  Deen  waiting  for  the 
shortest  period  of  time.  This  is  in  contrast  to  the  FCFS 
queues  where  service  will  always  be  extended  to  the  job 
which  has  had  the  longest  wait.  At  a LCFS  queue  a 
newly-arriving  job  will  join  the  front  of  the  waiting  line 
if  all  servers  are  occupied.  As  described  here,  the  LCFS 
queuing  discipline  is  nonpreempt ive  in  that  the  service 
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received  by  a job  canr.ot  be  interrupted.  However,  two 
variations  cf  preemptive  LCFS  queuing  disciplines  will  be 
considered  in  Chapter  II. 

At  a queue  having  a preemptive  LCFS  queuing 
discipline,  a newly-arriving  job  interrupts  the  service  of 
seme  other  job  if  no  servers  are  available.  The  job  which 
has  been  preempted  in  this  manner  then  joins  the  waiting 
line,  usually  at  the  front,  to  await  an  available  server. 

At  a queue  having  a last- come- first- served - 
pr eem ptiv e- resume  (LCFSPR)  discipline,  a job  whose  service 
has  been  interrupted  resumes  service  at  the  point  at  which 
the  last  interruption  took  place.  Thus,  the  service  time 
from  resumption  of  service  (given  no  further  interruption) 
has  a residual  life-time  distribution.  In  the  case  that  the 
(uninterrupted)  service  times  are  exponentially  distributed, 
these  residual  life-times  are  identically  distributed  with 
the  uninterrupted  service  times.  In  the  case  that  the 
service  times  have  a generalized  Erlangian  service 
distribution  (see  subsection  4.1),  the  job  resumes  service 
in  the  stage  cf  service  it  last  occupied. 

A natural  companion  to  the  LCFSPR  discipline  is  the 
lasz-come-f irst- serve d-preemp tive- re peat  ( LCFSPRpt)  queuing 
discipline  in  which  a job  must  "start  from  scratch"  each 
time  in  receives  service.  Unfortunately,  such  a discipline 
destroys  the  renewal  character  of  the  queuing  system,  and  it 
is  this  renewal  character  which  permits  the  use  of  the 
embedded  Markov  chain  approach  discussed  in  section  3.  The 
reason  for  this,  as  pointed  out  by  Gaver  [35],  is  that  the 
service  time  of  a job  whose  service  was  previously 
interrupted  is  constrained  to  be  at  least  as  large  as  the 
amount  of  service  time  received  prior  to  the  interruption. 

As  a rough  approximation  to  such  a situation,  however, 
LCFSPRpt  will  be  used  to  refer  to  a preemptive  LCFS  queuing 
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discipline  in  which  a previously  interrupted  job  is 
constrained  to  experience  all  stages  of  service  previously 
entered,  but  not  constrained  to  spend  the  amount  of  tine  in 
a stage  that  it  previously  spent  there.  For  example, 
suppose  a LCFSPRpt  queue  has  a generalized  Erlangian  service 
distribution  as  depicted  in  Figure  1.4  with  k = 5 stages. 

If  the  service  of  a job  is  interrupted  while  it  is  in  the 
third  stage  (Q^) , then  that  job  is  constrained  to  experience 

service  "at"  Q , Q and  Q (unless  again  interrupted  before 
12  3 

"entering"  Q or  Q ) each  time  it  receives  service,  until  it 
2 3 

finally  ccmpletes  its  service  time  at  that  queue.  In  effect 

p , p and  p are  each  restricted  to  be  eaual  to  one  for 
1 2 3 

this  job  until  its  service  time  is  complete  and  it  leaves 

the  queue.  Eut  each  time  it  enters  Q , for  example,  it 

receives  a different  (exponentially  distributed)  service 

time  there.  So  defined,  LCFSPRpt  is  identical  to  LCFSPR  if 
the  service  times  are  exponentially  distributed. 

A queue  is  said  to  have  a class  priority  queuing 
discipline,  cr  simply  a priority  queuing  discipline  for 
short,  if  different  classes  cf  jobs  enter  the  queue  (or 
entering  jobs  are  assigned  to  different  classes) , and  jobs 
in  some  class  always  receive  service  before  jobs  in  some 
other  class.  Such  disciplines  exist  in  military  life  and 
fall  under  the  catagory  of  "ran*  has  its  privileges."  For 
example,  if  an  admiral  and  an  ensign  are  both  waiting  for  a 
haircut  in  a military  barber  shop,  the  admiral  will  be 
served  first,  even  if  the  ensign  arrived  first.  In  computer 
systems  it  may  oe  desirable  to  give  short-running  jobs 
priority  ever  longer-running  jobs  at  a central  processing 
unit.  This  example  points  to  the  fact  that  different 
classes  of  jobs  may  have  different  characteristics  at  the 
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queue,  fcr  example,  different  service  disciplines. 


As  with  the  LCFS  disciplines,  priority  queuing 
disciplines  may  be  either  preemptive  or  nonpreempti ve.  The 
comments  concerning  LCFSPR  and  LCFSPHpt  disciplines  apply  in 
this  regard.  Whether  preemptive  or  nonpreemptive,  if  the 
queuing  discipline  is  priority,  the  waiting  jobs  with 
highest  priority  will  be  at  the  front  of  the  line;  and  those 
with  the  lowest  priority  will  be  at  the  back. 

Many  priority  schemes  have  been  devised.  Indeed, 
different  computer  manufacturers  recommend  different 
schemes,  and  different  computer  facilities  having  the  same 
computer  system  often  employ  different  schemes.  In  general, 
the  techniques  to  be  studied  in  Chapter  II  can  be  applied  if 
the  class,  or  priority,  of  a job  does  not  change  once  it 
enters  a queue.  These  techniques  can  also  be  applied  in 
some  cases  in  which  priority  changes  take  place.  However, 
in  other  cases,  such  as  the  interesting  ones  suggested  by 
Jackson  [57]  and  Kleinrock  and  Finkelstein  [69],  tae  renewal 
character  of  the  system  is  disturbed  and  the  techniques 
cannot  be  applied. 

Many  articles  have  been  written  about  the  so-called 
round-robin  (HR)  queuing  disciplines  in  which  each  jcb  at 
the  queue  is,  in  succession,  given  a burst  of  service  cf 
fixed  length  q (or  less  if  less  is  required  to  complete  the 
service  of  the  job) . Among  the  authors  which  compare  the  HR 
disciplines  to  other  disciplines  are  Kleinrock  [67], 
Kleinrock  and  Muntz  [70]  and  Rasch  [90].  The  advantage  of 
such  a discipline  is  that  short-running  jobs  do  not  wait  in 
queues  for  excessive  periods  of  time  while  long-running  jobs 
are  receiving  service,  and  long-running  jobs  are  not 
enqueued  for  excessive  periods  of  time  wnile  short- r unning 
jots,  given  a higher  priority,  return  to  the  queue  time  and 
time  again  keeping  them  at  the  back  of  the  line.  The  size 


i 
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of  q should  he  kept  short  enough  to  allow  short-running  jobs 
to  pass  through  the  queue  in  a reasonable  time,  and  yet  long 
enough  tc  prevent  system  overhead  (time  spent  saifting  from 
jot  to  jot  rather  than  working  on  jobs)  from  becoming 
excessive.  System  overhead  is  considered  in  the  models  by 
Heacox  and  Purdoa  [51].  Some  of  the  literature  on  RR 
disciplines  is  concerned  with  "optimal"  choice  of  q. 

Unf  ortunately , the  fixed  length,  q,  of  the  service 
burst  disturbs  the  renewal  character  of  models  of  such 
queues.  This  makes  a successful  embedded  Markov  chain 
approach  based  upon  a continuous  time  Markov  process 
unlikely.  Using  seme  simplifying  assumptions  concerning  the 
relationship  between  g and  the  service  time  distributions,  a 
discrete  time  Markov  chain  approach  can  be  used  to  analyze 
ES  queues.  Such  an  approach  has  been  used  by  Bhandarkar 
[1C]  and  Easkett  and  Smith  [8].  Discrete  time  parameter 
methods  are  not  discussed  in  this  thesis.  The  reader  is 
referred  to  a series  of  articles  by  Neuts  [82],  lieuts  and 
Klimko  [ 83,84  ] and  Neuts  and  Heimann  [85]. 

However,  totally  ignoring  system  overhead  and 
allowing  the  length  of  service  burst  q to  approach  zero,  a 
"limiting"  queuing  discipline,  referred  to  as  processor 
sharing  JI51 # results.  One  description  of  a PS  discipline 
is:  "In  a period  of  length  t,  in  which  the  number  of  jobs  n 

at  the  queue  does  not  change,  each  job  receives  service  of 
length  t/n;  that  is,  each  job  receives  (1/n)-th  of  the 
service  effort  of  the  queue."  The  effect  of  such  a 
description  is  that  if  a job  has  service  time  distributed 
exponentially  with  rate  c,  its  waiting  and  service  time  is 
distributed  exponentially  with  rate  nc  so  long  as  there  are 
n jobs  at  the  queue.  It  is  in  this  context  that  the  PS 
queuing  discipline  will  be  used  in  this  thesis. 

A generalization  of  this  concept  is  given  by  Kelly 
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£64].  O'loncvan  [86]  has  suggested  several  models  of  a 
processor  sharing  gueue.  A bibliography  of  models  of 
processor  sharing  gueues  is  contained  in  Babad  [3]. 

4.3.  Multiserv er  Queues 

Having  discussed  service  distributions  and  queuing 
disciplines,  consideration  must  now  be  given  to  another 
property  of  queues,  the  nuaoer  of  servers.  Consider  a queue 
which  has  m > 1 servers  and  one  of  the  queuing  disciplines, 
other  than  PS,  discussed  in  the  preceding  subsection.  Then, 
if  there  are  n jobs  at  the  queue,  the  number  of  these  jobs 
receiving  service  is  n,  if  n < m,  and  m,  if  n > m.  The 
number  awaiting  service  is  0,  if  n < m,  and  n - m,  if  n > m. 

As  pointed  out  above,  the  check-out  counters  of  a 
large  grocery  store  form  a parallel  system  of  FCFS  queues. 

By  way  of  contrast,  some  banks  (and  post  offices)  have  a 
single  waiting  line  for  all  tellers.  The  first  customer  in 
line  moves  tc  the  next  available  teller.  This  is  an  example 
or  a single  multiset var  FCFS  queue. 

when  the  number  of  servers  is  at  least  as  large  as 
the  maximum  number  of  jons  which  can  ce  at  the  queue  at  a 
time,  the  queue  has  what  is  called  an  infinite  server  JIS]_ 
iMiliiiiS  iisci_pline.  Note  that  this  need  not  mean  tnat  there 
are  an  infinite  number  of  servers  if  the  queue  has  a finite 
capacity,  or  if  it  is  in  a closed  network  of  queues.  When 
the  number  of  servers  at  a queue  becomes  (effectively) 
infinite,  all  queuing  disciplines  act  the  same  way.  This  is 
why  IS  is  considered  to  be  a queuing  discipline.  Also, 
notice  that  a PS  queuing  discipline  is  an  IS  queuing 
discipline  in  which  the  service  degrades  each  time  another 
jot  arrives  and  improves  each  time  one  leaves. 


43 


n 


On  the  other  hand,  a PS  queue  can  also  have  multiple 
servers.  For  example,  suppose  a PS  queue  has  m servers. 

Then,  if  there  are  n jobs  at  the  queue,  each  job  receives 
its  full  measure  of  service  (as  though  the  queue  were  an  IS 
queue)  if  n < m,  and  (m/n)  times  its  full  measure  of  service 
if  n > m . 

4.4.  Capacity  and  Blocking 

I 

One  final  property  of  a queue  is  its  capaci tv , that 
is,  the  maximum  number  of  jobs  which  can  reside  at  the  queue 
(both  in  service  and  enqueued)  at  any  given  time.  In  a 
single-queue  system  jobs  which  arrive  when  the  queue  is  at 
capacity  are  turned  away  and  lost  to  tne  system.  Seme 
authors  have  incorporated  this  same  idea  into  queuing 
networks . 

Fcr  example,  Hannibalsson  [49]  examines  a network  of 
twe  queues,  as  depicted  in  Figure  1.7,  both  having  finite 
capacity.  A newly  arriving  job  enters  the  first  queue  (<2^) 

if  there  are  fewer  than  N jobs  (the  capacity  of  Q ^ ) engueued 

and  in  service  there.  If  N jobs  are  at  Q when  a job 

arrives,  the  job  immediately  leaves  the  system.  (The  input 

process  is  Pcisson  and  both  queues  have  FCFS  exponential 
servers.)  A jcb  completing  service  at  Q ^ leaves  the  system 

with  prooability  (1  - p)  or  proceeds  to  the  second  queue 

(Q^)  with  probability  p.  If  it  finds  M jobs  (the  capacity 

of  Q ) already  at  Q when  it  arrives,  it  will  leave  the 
2 2 

system.  A job  completing  service  at  Q will  return  to  1 
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ove 


where  it  will  be  treated  as  though  it  were  a newly  arriving 


jot . 


The  advantage  of  imposing  capacities  on  queues,  or 
cn  a queuing  network  as  a whole,  is  that  doing  so  very  often 
yields  a finite  state  space.  For  example,  in  Hannibalsson* s 
model  (Figure  1.7)  the  states  of  the  system  can  be 
described  in  terms  of  ordered  pairs  (n,m)  of  nonnegative 
integers  such  that  n is  no  larger  than  N and  m is  nc  larger 
than  M.  Thus,  the  number  of  states  which  need  be  considered 
is  no  larger  than  (N+1)  x (H+1). 

In  closed  networks  of  queues  this  same  advantage  is 
enjoyed.  The  number  of  states  is  finite  (in  many  cases) 
since  the  number  cf  jots  is  fixed.  Heiser  and  Kobayashi 
[93]  discusses  a " semi-closed"  network  of  queues  in  which 
the  total  number  of  jobs  is  constrained  to  be  no  larger  than 
k"  and  no  smaller  than  k' . A job  is  turned  away  if  it 
attempts  to  enter  the  system  when  k"  jobs  are  already  there. 
Similarly,  a job  is  not  allowed  to  leave  the  system  if  there 
are  k'  jots  in  the  system  (including  it).  These 
restrictions  lead  to  a finite  state  space. 

Since  a treatment  such  as  that  of  Hannibalsson,  in 
wnich  any  job  encountering  a queue  at  capacity  leaves  the 
system,  is  net  usanla  in  a closed  network  of  queues, 
additional  ways  of  handling  queues  with  finite  capacity  in  a 
network  are  needed.  One  possibility  is  to  allow  a job  to 
"skip"  any  queue  which  is  at  capacity.  For  example, 
consider  the  closed  network  depicted  in  Figure  1.1  with  11 
jots  circulating  in  the  system.  Further,  suppose  that  Q 

M+1 

has  a capacity  of  n < N jobs.  Any  job  completing  service 

at,  say,  Q when  there  are  n jobs  at  Q will  skip  Q , 

1 M+1  M+1 
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experiencing  neither  waiting  time  nor  service  time,  and 


proceed  immediately  to  with  probability  p^,  with 

probability  p , and  sc  forth.  If  one  or  more  of  Q , Q , 

2 1 2 

...»  Q are  also  at  capacity,  the  analysis  becomes  a little 
M 

more  complicated,  but  the  idea  is  the  same.  The  "service 

deletion"  mechanism  of  Jackson  [61]  is  equivalent  to 
skipping  as  described  here. 


Skipping  seems  a little  arbitrary.  However,  a 
alternative  exists,  that  of  blocking.  Again  consider 
example  introduced  in  the  preceding  paragraph,  except 


jobs 
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not 

allowed 

to  skip.  Then  a 

job  completing  s 

at  Q 

1 

wh 

en 

there  are 

n jobs  at  Q is 

M+1 

blocked 

from  en 

Q 

iJ+1 

unt 

il 
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job  lea 

ves  Q . Hence, 

M+1 

it  must 

remain  a 

In  turn. 

the 

blocked 

job  continues  to 

occupy  a 

server 

server,  if  there  is  only  one)  at  Q , thereby  blocicing 


engueued  at  g^  from  receiving 

serve  as  an  "overflow  waiting 

the  capacity  of  Q would  be 

M ♦ 1 

twc-queue  model  with  blocking 


service.  (If  not,  Q co 

1 

room"  for  Q and,  in  e 
M+  1 

increased.)  A simple 
has  been  discussed  by  Ad 


Hofri  and  Yadin  [ 1 j. 

A problem  which  can  arise  in  networks  with  bio 
is  deadlocking.  Again  consider  the  example  discussed 
If  Q is  also  at  capacity  and  has  a single  server,  no 


can  receive  service  at 
unblocking  the  job  at 
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also  has  a single  server,  and  that 


Q . Suppose  that  Q 

M+1 

a job  completes  service  at  Q and  is  destined  for  Q . 

M + 1 1 

Since  is  at  capacity,  this  job  is  blocked  and  blocks  any 

further  service  activity  at  Q . Thus,  the  two  queues  are 

M+ 1 

blocking  each  ether  and  no  service  activity  can  take  place 
in  either.  This  is  called  deadlocking. 

Gordon  and  Newell  [47]  discussed  a closed  cyclic 
network  of  gueues  (jobs  leaving  queue  i proceed  only  tc 
queue  i + 1;  jobs  leaving  the  last  queue  proceed  only  to  the 
first  queue)  in  which  one  or  more  queues  have  finite 
capacity  and  blocking  results.  However,  as  formulated  by 
Gordon  and  Newel,  a blocked  job  must  repeat  service  while 
waiting  tc  be  unblocked.  Hence,  unlike  the  blocking  model 
discussed  abeve,  only  one  job  can  move  between  queues  at  any 
instant.  Results  are  given  only  for  some  special  cases  of 
the  cyclic  model  discussed.  This  and  the  fact  that  very  few 
authors  address  blocking  bear  testimony  to  the  analytic 
difficulty  of  the  subject. 

Nonetheless,  models  involving  blocking  and  queues 
having  finite  capacity  are  appropriate  in  the  computer 
world.  Ceadlccking,  for  example,  is  discussed  by  Havender 
[50]  as  a real  problem  in  raultiprogrammed  computers.  In 
Chapter  II  seme  space  will  be  devoted  to  modelling  in  cases 
involving  blocking  and  queues  with  finite  capacity. 

5.  REVIEW  OF  QUEUING  NETWORK  LITERATURE 

This  section  consists  of  a review  of  the  major  papers  on 
the  subject  cf  queuing  networks,  particularly  Markovian 
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queuing  networks.  No  attempt  has  been  made  to  be  exhaustive 
in  this  review.  Indeed,  in  many  cases  where  some  particular 
work  summarizes  and  extends  earlier  works,  only  the  most 
recent  (or,  in  some  sense,  the  most  complete)  is  cited. 

These  interested  in  extensive  research  into  this  subject 
could  use  the  references  in  this  section  and  earlier 
sections  as  a starting  point  and  investigate  the  references 
in  the  cited  works  for  further  depth  and  background. 

E.  A.  Torbett  [105]  in  an  appendix  to  his  PhD  thesis  has 
an  excellent  review  of  some  of  the  early  research  in  queuing 
networks.  The  first  sucsection  of  this  section  parallels 
Torbett's  appendix,  although  the  emphasis  here  differs 
somewhat  from  that  in  lorbett's  work. 

The  remaining  subsections  are  arranged  mere  by  problem 
approach  than  chronologically.  A very  good  review  of  this 
material  has  recently  been  published  by  Lemoine  [77]. 


5.1.  E^r ly  Work 

One  of  the  most  important  features  of  any  network  of 
queues  is  that  the  output  stream  from  certain  of  the  queues 
contributes  to  the  input  stream  at  certain  other  queues.  As 
a result  it  is  hoped  that  known  results  concerning 
individual  queues  will  be  applicable  in  studying  networks  of 
such  gueues.  In  this  regard  it  is  apparent  that  some 
knowledge  of  the  departure  process  of  an  individual  queue  is 
required . 


Burke  [15]  took  the  first  step  in  setting  the  stage 
for  the  study  of  Markovian  queuing  networks.  He 
investigated  the  departure  process  from  a single  FCFS  queue 
witn  multiple  (identical)  exponential  servers  given  a 
Poisson  arrival  process.  Assuming  that  the  traffic 
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1 


intensity  (the  ratio  of  the  arrival  rate  to  the  maximum 
service  rate)  is  less  than  one,  so  that  steady-state  exists, 
Burke  proved  that  tne  steady-state  departure  process  is 
identical  to  the  Poisson  arrival  process  and  independent  of 
the  queue  size  left  by  a departing  job.  Since  the 
steady-state  distribution  of  the  queue  size  for  the  M/M/s 
queue  is  well-known  (see  Kleinrock  [68],  for  example),  the 
implication  of  this  result  to  an  open  network  consisting  of 
a series  connection  cf  such  queues  is  immediate. 

Consider  a series  connection  of  N queues.  For  each 

i = 1,  2,  ...,  N , suppose  that  queue  i has  s identical 

i 

exponential  servers.  Suppose  further  that  jobs  enter  the 

system  in  a Ecisson  arrival  stream  at  the  first  queue  and 

depart  from  the  system  in  a departure  stream  from  the  M-th 

queue  after  experiencing  service  at  each  queue  in 

succession.  Also  suppose  that  the  traffic  intensity  at  each 

queue  is  less  than  one  if  the  rate  of  the  Poisson  arrival 

stream  is  used  in  each  calculation.  Burke's  results  show 

that  the  input  process  for  each  of  the  N queues  is  identical 

to  the  input  process  to  the  system.  Thus,  the  i-th  queue  is 

an  M/M/s  queue  with  known  interarrival  and  service 
i 

distributions . The  independence  proved  by  Eurke  indicates 

that  the  joint  steady-state  probability  of  finding  n jobs 

i 

at  queue  i for  i = 1,  2,  ...,  N is  the  product  over  i of  the 

steady-state  probabilities  of  finding  n jobs  at  queue  i, 

i 

considered  as  an  individual  M/M/s  queue.  This  result  was 

i 

displayed  by  H.  B.  P.  Jackson  [59]. 

Since  the  superposition  cf  independent  Poisson 
processes  is  a Poisson  process,  this  result  extends  easily 


tc  networks  in  which  several  (or  all)  of  the  queues 
experience  arrivals  frcm  outside  the  network.  The  fact  that 
probabilistic  filtering  of  a Poisson  process  results  in  a 
Poisson  process  facilitates  extension  to  nonserial  networks 
so  long  as  there  is  no  feedback.  (A  queuing  network  has 

1 

feedback  if  paths  exist  which  could  allow  a job  to  return  to 
a queue  at  which  it  has  already  received  service.) 

1 

Indeed,  even  feedback  can  be  accommodated,  except 
that  the  rate  of  the  input  process  to  some  of  the  queues  is 
net  so  readily  ascertainable.  J.  R.  Jackson  [56]  considered 
a rather  general  open  network  of  N queues  in  which,  for  i = 

1,  ...,  N, 

1.  Queue  i has  s identical  exponential  servers. 

i 

2.  Jobs  from  outside  the  network  arrive  at  queue 

i in  a Pcisson  stream  with  rate  r . 

i 

3.  All  queuing  disciplines  are  FCPS. 

4.  Jobs  departing  queue  i route  (instantaneously) 
to  queue  j with  probability  p or  leave  the 

ij 

system  with  probability  1 - (p  + p + ...  + 

il  i2 

P . ) • 
iN 

Noting  that  the  arrival  process  to  any  given  queue  is  the 

superposition  cf  arrivals  from  outside  the  system  and 

arrivals  frcm  each  of  the  N queues  within  the  system, 

Jackson  defined  the  average  arrival  rate  of  jobs  at  queue  i 

to  be  R and  stated  that  in  steady-state 
i 

N 

(1.9)  R.  = r.  ♦ 2 P ,R 

1 1 . , ji  j 

j = 1 

He  then  proceeded  to  prove  that  the  joint  steady-state 


51 


probability  cf  finding  n jobs  at  queue  i for  i =1,2,  ..., 

i 

N is  the  product  over  i of  the  steady-state  probability  of 

finding  n jcbs  at  an  M/M/s  queue  with  arrival  rate  R and 
i i i 

service  rate  equal  to  the  service  rate  at  queue  i.  This  is 

exactly  the  result  given  by  R.  R.  P.  Jackson,  but  with  the 

arrival  rates  determined  by  solving  the  system  of  linear 

eguations  (1.9).  Note  that,  with  r =0  and  the  sum  over  j 

i 

of  p equal  to  one,  Jackson's  model  is  a closed  network  of 

ij 

queues.  This  offers  some  hope  that  a product-form  solution 
may  also  be  valid  fcr  closed  networks. 

Burke  proved  his  results  (see  the  beginning  of  this 
sutsecticn)  under  the  assumptions  of  an  homogeneous  Poisson 
arrival  process,  identical  exponential  servers,  an  infinite 
capacity  and  identical  jobs.  With  reference  to  the 
discussion  in  the  preceding  section,  it  is  natural  to  ask 
questions  concerning  extensions  of  Burke's  results.  Fcr 
example,  what  can  be  said  about  the  departure  process  if  the 
rate  of  the  arrival  process  depends  upon  the  number  of  jobs 
at  the  queue;  or  if  the  rate  of  service  is  a more  general 
function  cf  the  number  of  jobs;  or  if  the  queue  has  a finite 
capacity;  or  if  the  interarrival  or  service  times  have 
generalized  Erlangian  distributions;  or  if  arriving  jots  are 
cf  different  classes,  with  the  arrival  process  and  service 
distributions  differing  with  class?  Few  of  these  questions 
have  been  answered. 

Reich  [91]  extended  Burke's  work  to  show  that  the 
service  time  distribution  must  be  either  exponential  or  a 
step  function  at  zero  (that  is,  no  service  time  at  all)  if 
both  input  and  output  processes  are  to  be  Poisson.  Finch 
[3u]  showed  that,  in  order  for  the  departure  process  tc  be 
independent  cf  the  queue  size  left  ay  a departing  job,  the 
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service  times  must  be  exponential  and  the  queue  cannot  have 
finite  capacity.  Reich  also  showed  that,  if  the 
interarrival  times  and  service  times  both  have  two-stage 
Erlang  distributions,  the  output  process  of  a single  server 
queue  is  not  identical  to  the  input  process.  These  results 
held  forth  little  hope  for  finding  product-form  solutions 
fer  networks  of  queues  incorporating  some  of  the 
generalizations  discussed  in  the  preceding  section. 

However,  it  must  be  noted  that  R.  R.  P.  Jackson, 
being  most  probably  unaware  of  Burke’s  result  which  was 
published  later  than  his  own,  did  nor  use  Burke’s  result. 
Furthermore,  although  J.  B.  Jackson  acknowledged  both 
Burke's  paper  and  Reich's,  he  used  tne  same  solution  method 
as  did  R.  R.  P.  Jackson.  Both  authors  derived  the 
equilibrium  balance  equations  in  the  usual  manner  (see 
Appendix  A) , stated  the  solution  and  proved  that  the 
solution  satisfied  the  equations  by  simple  substitution. 

This  same  method  was  used  by  Koenigsberg  £74],  who 
was  one  of  the  first  to  exhibit  a product-form  solution  for 
a dosed  network  of  queues,  and  by  Finch  [33],  whose  model 
included  a nenhomogeneous  Poisson  arrival  process. 

Kcenigsb erg  * s model,  termed  a cyclic  queue . consisted  cf  a 
series  of  queues  in  which  jobs  leaving  the  last  queue 
entered  the  first  queue.  This  is  a submodel  of  one  of  the 
two  models  considered  by  Finch.  Finch's  models,  both  cf 
which  were  open  networks,  incorporated  simple  forms  of 
feedback.  Jobs  arrived  at  the  network  in  an  homogeneous 
Poisson  arrival  stream,  but  were  turned  away  whenever  the 
network  contained  a specified  number  cf  jobs  (the  capacity 
of  the  network) . In  this  way  Finch  used  a nonhomogenecus 
Poisson  arrival  process  to  maintain  a finite  state  space. 

Gordon  and  Newell  [46]  showed  that,  because  of  the 
form  of  the  nenhomogeneous  Poisson  arrival  process  used. 
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Finch's  models  are  equivalent  to  closed  queuing  network 
models  ccrtaining  one  additional  queue.  This  queue  has  a 
single  exponential  server  with  service  rate  equal  to  the 
rate  of  the  Fcisson  arrival  process  of  tne  equivalent  open 
model.  At  any  instant  the  number  of  jobs  at  this  auxiliary 
queue  may  be  determined  by  subtracting  the  number  of  jobs  in 
the  remainder  of  the  network  from  the  network  capacity. 

Thus,  when  the  network  is  at  capacity,  there  are  no  jots  in 
the  auxiliary  queue  and  there  can  be  no  "arrivals."  On  the 
other  hand,  when  the  network  is  below  capacity,  there  is  a 
job  in  service  at  the  auxiliary  queue  and  "arrivals"  occur 
at  the  appropriate  rate. 

In  this  same  paper  Gordon  and  Newell  went  on  tc 
consider  an  arbitrary  closed  network  of  M queues  with  N 
identical  jots  circulating  in  it.  For  each  i = 1,  2,  ..., 

M,  queue  i is  assumed  to  have  an  arbitrary  number,  r , of 

identical  exponential  servers.  Indeed,  their  model  is 

exactly  the  model  of  J.  S.  Jackson  discussed  earlier  with 
exogenous  arrival  rates  ail  set  equal  to  zero  and  with  the 
sum  over  j cf  p equal  to  one.  After  deriving  the  balance 

ij 

equations,  they  assumed  a product-form  solution  and  proved 

that  the  jcint  steady-state  probability  of  finding  n jobs 

i 

in  queue  i for  i = 1,  2,  ...,  M is  given  by 


(1.10) 


F (n  , n , . . . , n ) 

1 2 A 


A 

-1  n, 

= G (N)  2 x 1 /b  (n  ) 
i i i 

i=  1 


ifn  + n +...+n 
1 2 A 


otherwise.  In  (1.10) 


= N,  and  P(n  ,n  ,...,n  ) = 0 

i 2 n 

- 1 

G (N)  is  a normalizing  constant 


which  depends  upon  the  number 


of  jobs  in  the  network. 


< r 

i 


> r 

i 


and  x is  proportional  to  the  probability  of  finding  a job 
i 

in  queue  i in  the  special  case  that  N = 1.  The  x can  be 

i 

found  by  solving  the  (usually  much  smaller)  system  of 
equations: 


n i 


if  n 


(1.11) 


b . (n. ) = 

1 i 


(r . !)  r 

l i 


ni  ~ri 


if  n 


M 

( 1 - ^ 2 ) mx  = 2 mpx 

i i . „ j ji  j 

where  m is  the  rate  of  service  for  a single  server  at  queue 
i 

i and  p is  the  probability  that  a job  leaving  queue  j will 

ji 

next  enter  queue  i. 

Gordon  and  Newell's  model  is  a special  case  of  a 
very  general  model  considered  in  an  earlier  work  by  J.  3. 
Jackson  [56],  of  which  Gordon  and  Newell  were  apparently 
unaware.  Jackson's  new  model  consisted  of  an  arbitrary 
network  of  queues  similar  to  that  considered  in  his  earlier 
work  (in  [56])  discussed  earlier  in  this  section.  Unlike 
his  earlier  model,  however,  this  new  model  assumed  jobs 
entered  the  network  in  a Poisson  arrival  stream  whose  rate 
depended  upcn  the  total  number  of  jobs  in  the  network.  Tne 
choice  of  queue  at  which  to  enter  was  made  in  a Markovian 
manner  according  to  a fixed  probability  distribution. 

Service  at  the  queues  was  exponential  with  a rate  which 
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defended  not  only  on  the  queue,  but  also  on  the  number  of 
jobs  at  the  queue. 


In  addition,  Jackson  incorporated  two  mechanis 
"triggered  arrival"  mechanism  and  a "service  deletion" 
mechanism.  The  triggered  arrival  mechanism  provided  f 
lower  bound  on  the  total  number  of  jobs  in  the  network 
Hhen  the  number  of  jobs  in  the  network  equaled  this  lo 
bound,  a departing  job  was  immediately  reinserted  into 
network  as  a newly  arriving  job. 


ms , a 

or  a 

wer 

the 


The  service  deletion  mechanism  provided  for  finite 
capacity  at  individual  queues.  This  was  accomplished  by 
automatically  ejecting  the  job  in  service  at  a queue 
whenever  a new  job  arrived  and  found  the  queue  at  capacity. 
Thus  ejected,  the  job  proceeded  to  another  queue  or  left  the 
network  as  though  it  had  just  completed  its  service.  As 
pointed  cut  in  subsection  4.4  of  this  chapter,  this  is 
equivalent  tc  a job  bypassing  any  queue  at  capacity  that  it 
encounters. 


Jackscn  showed  in  [58]  that  the  balance  eq 
for  the  steady-state  probabilities  have  a product- 
solution.  like  Gordon  and  Newell,  ne  showed  that 
factors  of  this  product-form  solution  can  be  deter 
solving  a considerably  smaller  set  of  linear  equat 
However,  because  of  tne  generality  of  the  model,  J 
solution  procedure  is  more  difficult  to  apply  than 
similar  procedure  described  by  Gordon  and  Newell, 
reason  it  is  Gordon  and  Newell's  model,  rather  tha 
Jac/cson's,  which  has  been  widely  examined  and  appl 
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5.2.  Applications  to  Computer  Systems 


Spencer  and  Sheng  [103]  have  reported  using 
Jackson's  earlier  model  in  a study  of  multiprcgrammed 
time-sharing  computer  systems.  Avi-Itzhak  and  Hevman  [2], 
Buzen  [17],  Chiu,  Curmcnt  and  Wood  [25]  and  Kaneko  [62]  have 
used  the  results  in  Gordon  and  Newell's  paper  [46]  to 
investigate  various  aspects  of  a multiprogrammed  computer 
system.  Torbett  [105]  used  Gordon  and  Newell's  result  in  an 
examination  cf  optimal  control  of  closed  queuing  networks 
with  adjustable  service  rates. 

Gaver  [38]  modelled  a multiprogrammed  computer 
system  as  a closed  central  server  network  of  single  server 
queues  as  depicted  in  Figure  1.1.  He  then  showed  that,  for 
this  model,  Gordon  and  Newell's  result  (1.10)  reduces  to 


a 

-1  n: 

(1.13)  F(n  ,n  ,...,ri  ) = G (N)  TT  x . 

12  « + 1 l 

i=  1 


where  for  each  i = 1,  2,  ...»  a. 


(1.14)  x = m p/m 

i a+ 1 i i 


where  m is  the  exponential  service  rate  at  0 and  p is  as 
i i i 

in  Figure  1.1.  He  then  used  this  formulation  to  derive 

-1 

G (N)  and  several  measures  of  system  performance,  such  as 

the  idleness  probability  for  each  of  the  queues.  The 
solution  given  by  (1.13)  will  be  used  in  later  chapters  for 
comparison  with  nuaerical  results  using  the  methodology 


developed  1b  Chapter  II. 


In  principle,  the  value  of  G (N)  in  (1.10)  can  he 
determined  by  appealing  to  the  normality  condition,  wnich 
says  that  the  sum  of  steady-state  probabilities  is  unity. 

That  is,  once  x has  been  determined  from  (1.12), 
i 

G(N)P(n  ,...,n  ) can  be  calculated  (see  (1.10))  for  eacn 
1 M 

state.  Ihese  quantities  are  then  added  over  all  stares  to 

yield  G (N) . Unfortunately,  as  N and  ft  become  large,  the 
total  number  of  states  becomes  large  combinatorially . This 
forces  the  use  of  digital  computers.  Special  pains  must  be 
taken  to  see  that  too  much  is  net  lost  due  to  round  off. 

This  problem  is  discussed  in  Dorn  and  McCracken  [29]. 

Euzen  [IS]  studied  Gordon  and  Newell's  product-form 
result  for  closed  queuing  networks  and  developed  an 

algorithm  for  determining  G(N)  using  the  x 's  from  (1.12). 

i 

Intermediate  results  are  G(1),  G(2),  ...,  G ( N—  1 ) . He  then 

went  on  to  display  composite  measures,  such  as  the  marginal 

distributions,  P {n  = k}  , in  terms  of  G ( 1 ) , G(2),  ...,  G (N)  . 

i 

This  algorithm  solved  some  of  the  computational  problems 
facing  these  who  wish  to  use  Gordon  and  Newell's  results.  A 
good  review  of  this  algorithm  and  several  extensions  have 
been  giver  cy  Bhandiwad  and  Williams  [11]. 

5.3.  Local  3a lance  and  Quasi- reversibility 

In  the  same  year  that  Gordon  and  Newell's  much-cited 
work  [46]  was  published,  ?.  Whittle  [109]  presented  the  same 
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results  at  the  thirty-sixth  session  of  the  International 
Statistical  Institute.  The  next  year  an  article  by  Whittle 
[110]  was  published  in  which  he  displayed  a product-fora 
solution  for  open  queuing  networks,  reproducing  the  results 
of  Jackscn  [58]  (of  which  he,  too,  was  apparently  unaware). 
While  Jackscn's  work  was  remarkable  for  its  generality,  and 
Gordon  and  Newell's  for  its  simplicity,  the  impact  of 
Whittle's  work  has  been  the  introduction  of  tne  concept  of 
ioc 3I  balance,  also  referred  to  as  individual  balance  and 
partial  talance. 

The  talance  equations  considered  in  earlier  works 
(hereafter  referred  to  as  global  balance  equations  tc 
differentiate  them  from  the  local  balance  equations)  equate 
the  weighted  rate  of  flow  from  a given  state  to  the  weighted 
rate  of  flow  into  that  state.  The  weights  are  merely  the 
steady-state  probabilities  of  finding  the  system  in  the 
appropriate  state.  For  example,  the  global  balance 
equations  shewn  by  Gordon  and  Newell  to  have  (1.10)  as  their 
solution  are 


(1.15) 


{ ? min(n  ,r  )m  } P (n  ,...,n  ) 

i i i 1 M 

i=  1 


a m 

? 7 { min  (n  ♦ 1 , r ) m p } 

i i i ij 

i=1  j=1 


xP  (n  , . . . , n — 1 , . . . , n + 1 , 

1 j i 


where  m is  the  rate  of  the  exponential  service  times  at 
i 

queue  i,  r is  the  number  of  servers  at  queue  i,  and  p is 

i ij 

the  probability  that  a job  completing  service  at  queue  i 


will  next  rccte  to  queue  j 


The  local  balance  equations  equate  the  weighted  rate 
(same  wiegtts)  of  flow  from  a state  due  to  departure  from  a 
given  queue  to  the  weighted  rate  of  flow  into  the  state  due 
to  an  arrival  at  the  same  queue.  The  local  balance 
equations  corresponding  to  (1.15)  are 

(1.16)  ain(n  ,r  )a  P(n  ,...,n  ) = 

i i i 1 M 

M 

2 {min  (n  ♦ 1 , r ) o p } 
j j 3 ji 
3=1 

xP (a  , . . . i n ^1f.. - 1 , . . . , n ) 

1 \ j i d 

for  each  i = 1 ,2,  ...,  M such  that  n * 0. 

Summing  (1.16)  over  i yields  (1.15).  That  is,  if  a 
candidate  solution  satisfies  the  local  balance  equations,  it 
also  satisfies  the  global  balance  equations.  Whittle  showed 
that  a given  product  form  is  the  solution  to  the  appropriate 
set  of  global  balance  equations  by  showing  that  it  is  tne 
solution  tc  the  corresponding  set  of  local  balance 
equations.  This  same  technique  has  been  used  by  several 
authors  since  to  prove  that  a product  form  solution  exists 
for  a variety  of  network  problems. 

Combining  and  extending  the  results  of  several 
papers,  Haskett,  Chandy,  Muntz  and  Palacios  [6]  considered  a 
general  queuing  network  as  is  now  described.  The  number  of 
queues  is  arbitrary,  but  finite.  There  are  an  amitrary, 
but  finite,  cumber  of  job  types.  The  probability  that  a job 
of  type  r completing  service  at  queue  i will  next  enter 
queue  j as  a job  cf  type  s is  fixed.  The  system  may  be 
either  open  or  closed.  If  open,  arrivals  to  the  network 
occur  in  a Poisson  arrival  stream  with  rate  dependent  upon 
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A 


the  total  numter  of  jots  in  the  system,  or  in  a collection 
of  Poisson  arrival  streams,  one  for  each  ergodic  subchain  of 
the  Harkcvian  switching  matrix,  with  the  rate  of  each  stream 
dependent  upcn  the  number  of  jobs  in  the  corresponding 
subchain.  An  arrival  enters  the  system  at  a given  queue  as 
a given  type  job  with  fixed  probability.  Each  queue  is  one 
of  the  following  four  types: 

Type  _1:  A FCFS  queue  with  exponential  service 
having  rate  dependent  upon  the  number  of  jobs  in 
the  gueue,  but  not  their  types. 

2l£i  A single  server  PS  queue  with  generalized 

Erlangian  service,  dependent  upon  job  type. 

2l£s  An  IS  queue  with  generalized  Erlangian 

service,  dependent  upon  job  type. 

2l£=  4:  A single  server  LCFSPR  gueue  with 
generalized  Erlangian  service,  dependent  upon  job 
type. 

Using  the  local  balance  technique  of  Whittle, 
Baskett,  et . al.  showed  the  steady-state  solution  to  have 
the  product  form: 

a 

(1.17)  P{S  = <c  ,...,n  )}  = c d (S)  TT  f (n  ) 

id  1 i 

i=  1 

where  M is  the  numter  of  queues,  a is  a vector  whose 

i 

contents  and  structure  depend  upon  the  type  of  queue  i,  c is 

a normalization  constant,  1(3)  is  a constant  which  depends 

upcn  the  form  of  tne  arrival  process  (d{S)  = 1 if  the  system 

is  closed),  and  each  f (n  ) is  a product  whose  form  depends 

i i 

upcn  the  type  of  queue  i as  well  as  the  contents  of  n . 

“i 
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Chandy,  Keller  and  Browne  [22]  have  reported  tne 
development  cf  a computer  program,  referred  to  as  ASQ  (for 
"algebraic  scluticn  for  queues") , which  provides  both 
numerical  and  algebraic  solutions  to  many  types  of  queuing 
network  models.  The  models  which  are  amenable  to  analysis 
using  A3Q  are  submodels  of  the  general  model  of  Baskett, 
Chandy,  Muntz  and  talacios.  Recently  Reiser  [92]  has 
reported  the  development  of  an  interactive  computer  program, 
referred  to  as  QNET4,  which  provides  numerical  solution  to  a 
slightly  broader  class  of  models. 

Computation  simplifying  techniques  and  algorithms, 
seme  of  which  are  extensions  of  Buzen's  work  [18],  have  been 
proposed  for  many  of  the  product  form  solutions  proved  by 
Baskett,  et.  al.  Some  of  these  proposals  have  come  from 
Bhandiwad  and  Williams  [ 11,112],  Hine  and  Fitzwater  [52]  and 
Reiser  and  Kcbayashi  [95,96]. 

A comprehensive  treatment  of  local  balance  has  been 
given  by  Kingman  [66],  who  also  discusses  a stronger 
property  called  reversibility.  A Markovian  queuing  network 
is  said  to  be  reversibile  if  the  (unconditional)  rate  cf 
transition  from  a state  C to  any  other  state  D is  equal  to 
the  rate  cf  transition  from  D to  C.  Letting  g(C,D)  be  the 
conditional  rate  of  transition  from  C to  D,  and  letting  p(C) 
be  the  steacy-state  probability  associated  with  state  C,  the 
reversibility  condition  is 

(1.18)  F<C)q(C,D)  = p(D)q(D,C) 

for  each  pair  of  states  C and  D.  Reviewing  the  definition 
of  local  balance,  it  is  evident  that  every  reversible  system 
satisfies  the  conditions  of  local  balance.  Kingman  proved 
that  a product  form  solution  exists  for  each  irreducible 
reversible  system. 


62 


It  is  easily  seen  that  local  balance  is  not 
equivalent  to  reversibility.  The  tandem  queuing  models  of 
R.  R.  P.  Jackson  [59],  which  are  discussed  in  subsection 
5.1,  are  examples  of  irreversible  systems  which  satisfy  the 
ccnditicns  cf  local  balance.  Thus,  the  work  of  Whittle  and 
others  cited  above  show  that  reducibility , though 
sufficient,  is  not  necessary  for  the  existence  of  a prcduct- 
form  solution. 

The  wide  use  of  the  local-balance  technique  for 
proving  a product-form  solution,  and  the  lack  of  proofs 
based  on  weaker  criteria,  lead  naturally  to  a conjecture 
that  local  balance  is  necessary  and  sufficient  for  existence 
of  a product-form  solution.  However,  neither  necessity  nor 
sufficiency  has  been  proved. 

Very  recently  Kelly  [64]  proved  the  existence  cf  a 
product-form  solution  for  an  open  network  of  queues  with 
multiple  job  types  using  a property  he  terms 
guasi-re ver sibil it y.  Supposing  a Poisson  arrival  process 
and  classification  of  departing  jobs  into  groups  according 
to  the  job's  experience  in  the  network  (for  example,  its 
service  time) , Kelly  defined  a network  to  be 
quasi-reversitle  if  departures  of  the  different  groups  of 
jobs  form  independent  Poisson  processes  and  if  the  state  of 
the  network  at  any  time  is  independent  of  departures  up  to 
that  time.  Although  quasi-reversibility  implies 
reversibility,  the  relationship  between  quasi-reversibility 
and  local  balance  is  unknown. 

Defining  the  conditional  rate  of  departure  from 
state  C,  q (C) , by  : 
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(1.19) 


9(C) 


2 

D*C 


9 (C  , D) 


Kelly  proved  (see  Lemma  1 of  [64])  that: 

If  there  is  a set  of  positive  numbers  £p  (C) } 
adding  to  unity,  and  a set  of  nonnegative  numbers 
{g ' (C , D)  } such  that 


(1.20)  g (C)  =2  9'  (C,D) 

D*C 

and 

(1.21)  p (C)q(C,D)  = P(D)g*  (D,C) 

hold  for  all  states  C and  D,  then  {p  ( C) } is  the 
steady-state  distribution  which  satisfies  the 
global  balance  equations  for  the  system. 

He  then  considered  several  open  queuing  network  models  in 
which  an  entering  job  was  classified  by  type  according  to 
the  route  (finite  and  fixed  as  opposed  to  the  Markovian 
branching  probabilities  discussed  by  other  authors)  it  would 
take  through  the  network  and,  in  some  cases,  the  service 
distribution  it  would  experience  at  each  queue  it  visited. 

In  each  model  he  then  established  the  existence  of  a 
prcduct-rcrm  solution  by  developing  the  global  balance 
equations,  guessing  values  for  p (C)  and  q,(C,D),  proving 
that  (1.20)  and  (1.21)  are  satisfied,  and  appealing  tc  the 
lemma  summarized  above.  Toe  values  guessed  for  p (C)  and 
g ' (C,  D)  were  made  more  natural  by  the  relationship  between 
reversibility  and  quasi- reversibility . No  further  details 
will  be  given  here.  The  interested  reader  is  urged  to  read 
Kelly's  very  interesting  paper  [64]. 


Net  cnly  is  the  relationship  between  local  balance 


and  quasi-reversibility  not  clear,  but  also  the 
ap plicability  cf  the  lccal-balance  technique  to  Kelly's 
models,  and  the  applicability  of  Kelly's  quasi-reversibility 
techniques  tc  models  whose  product-form  solution  have  teen 
proved  using  the  local-balance  technique  are  not  clear.  For 
example,  it  is  not  known  whether  the  quasi-reversibility 
techniques  are  applicable  to  closed  queuing  networks.  The 
models  considered  in  this  thesis  are  more  easily  related  to 
the  models  of  Whittle  and  Baskett,  Chandy,  Muntz  and 
Palacios  than  those  of  Kelly. 

In  searching  for  a product-f or m solution  based  upon 
local  balance,  the  form  of  the  local  balance  equations  often 
suggests  the  form  cf  the  solution.  For  example,  since  the 
sum  over  j ox  the  p is  equal  to  unity  in  the  closed  model 

ij 

of  Gordon  and  Newell  discussed  above,  dividing  the  right 
side  of  (1.16)  by  the  left-hand  side  suggests  that 

(1.x2)  E (n  ,...,n  +1,...,n  — 1,...,n  J ~ 

1 j i M 

{[min(n  ,r  )m  p ] / [ min  (n  +1,r  )m  p ]} 
i i i ij  j j j ji 

xF  (n  , . . . ,n  ) 

1 M 

Assuming  a product  form  such  as 


M n . 

( 1 . 23)  P(n  ,...,n  ) = TT  (TT  y . ) 

1 M ik 

i=  1 k = 1 


leads  to 

(1.24) 


the  following  relationship 


a in  (n  ♦ 1 , r ) p y 

j 3 ji  j#n.  + 1 
j 
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min  (n  ,r  ) m p y 

i i i ij  i,n 

i 


A 


"Factoring  out"  the  dependence  of  y upon  n by  letting 

i 

( 1 . 25)  x = min (n  , r ) y 

i i i i,n 

i 

results  in 

(1.26)  mp  x = mp  x 

j ji  3 i ij  i 

Summing  (1.26)  over  j yields  (1.12).  The  result  (1.10)  of 

Gordon  and  Newell's  analysis  fellows  directly,  since  b (n  ) 

i i 

incorporates  the  relationship  given  in  (1.25). 

However,  it  is  not  difficult  to  devise  examples  in 
which  local  balance  does  not  hold.  For  example,  Sauer  and 
Chandy  [98]  consider  a closed  network  consisting  of  two  FCFS 
queues,  each  having  a single  exponential  server.  Two  jobs 
circulate  in  the  network.  The  lack  of  local  balance  is  a 
result  of  the  fact  that  the  two  jobs  have  different  service 
rates  at  cne  cf  the  queues. 

Since  product  fora  solutions  seem  to  be  closely 
related  tc  lccal  balance,  attempts  to  determine  steady-state 
sclutions  xcr  networks  which  do  not  satisfy  the  local- 
balance  conditions  either  have  been  numerical  in  nature  or 
have  involved  approximation  by  models  which  do  satisfy  the 
local-balance  conditions.  A brief  summary  cf  such  efforts 
is  given  in  the  next  subsection. 

5.4.  Numerical  and  Approximation  Methods 


Eased  on  Norton's  tneorem  in  electrical  circuit 


theory,  Chandy,  Herzog  and  loo  [20]  developed  a technique 
for  examination  of  networks  of  queues  in  steady-state.  This 
technique,  which  is  particularly  suited  to  examination  of 
the  behavior  cf  a subsystem  as  its  parameters  are  varied,  is 
best  explained  in  terms  of  an  example.  So,  consider  Figure 
1.6.  For  simplicity  suppose  that  N jobs  of  a single  type 
circulate  among  the  queues,  that  each  queue  has  a single 
FCFS  exponential  server,  and  that  the  choice  of  routing  to 

Q , Q or  Q is  done  in  a Markovian  manner  according  to  a 
4 5 6 

fixed  probability  distribution.  That  is,  suppose  that  the 

steady-state  probability  distribution  could  be  determined 
using  the  work  of  Gordon  and  Newell  [46  ].  Further,  suppose 
that  tne  (marginal)  performance  of  the  parallel  subsystem  of 
queues,  bounded  by  points  A and  E in  Figure  1.8,  is  of 
particular  interest. 


The  first  step  in  examining  this  system  is  to  "short 

out"  the  subsystem  as  depicted  in  Figure  1.9.  (This  is 

equivalent  tc  replacing  the  subsystem  by  a queue  with  zero 

service  time.)  Next,  for  each  n = 1,  2,  ...,  N,  the 

"shorted"  system  of  Figure  1.9  is  solved  to  determine  the 

rate  T (n)  at  which  jobs  pass  through  the  short  (from  A to  5) 

when  there  are  n jobs  in  the  system.  (For  this  example  the 

work  of  Kcenigsberg  [74],  discussed  in  subsection  5.1,  is 

applicable.)  Finally,  returning  to  Figure  1.8,  tne  portion 

of  the  original  network  exterior  to  the  subsystem  of 

interest  is  replaced  by  a single  composite  queue,  Q , having 

c 


a state  dependent  service  rate  T(n).  The  analogue  of 
Norton's  theorem  states  that  the  behavior  cf  the  subsystem 
in  the  resulting  simplified  system  (Figure  1.10)  is  the  same 
as  its  behavior  in  the  original  system  (Figure  1.8)  . 


rather 


Note  that  this  technique  reduces  the  analysis  cf  a 
large,  complex  system  to  the  analysis  of  M ♦ 1 
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igure  1 . 10- -Network  of  Figure  1.8  with  Composite  Queue  Replacing  Part  of  Network 


i 


smaller,  simpler  systems.  Also,  note  that  the  state 
dependent  service  rates,  I (n)  , of  the  composite  queue,  Q 

c 

are  not  affected  by  changes  in  the  values  of  parameters 

within  the  subsystem.  Thus,  analysis  of  the  sensitivity  of 

the  behavior  of  the  subsystem  to  changes  in  the  service 

rates  at  C , Q and  Q and  changes  in  the  routing 
4 5 6 

probabilities  can  be  accomplished  through  multiple  solution 

of  the  central-server  system.  Figure  1.10,  rather  than  the 
entire  complex  system.  Figure  1.8. 

Also  in  [20]  Chandy,  et.  ai.  show  that  similar 
analogues  to  Norton's  theorem  hold  exactly  for  the  networks 
of  Baskett,  et.  al . [6],  which  satisfy  the  local-balance 
conditions.  In  an  accompanying  paper  [21],  they  discuss  an 
iterative  algorithm,  based  upon  these  analogues  of  Norton's 
theorem,  for  arriving  at  approximate  solutions  to  network 
problems  which  do  not  satisfy  the  local-balance  conditions. 
It  is  apparent  from  the  examples  in  this  paper  that  setting 
of  tolerance  limits  for  use  in  the  algorithm  to  ensure  a 
given  degree  of  accuracy  in  the  final  solution  may  be  a 
difficult  problem.  The  same  tolerance  limits  yield 
different  degrees  of  accuracy  in  different  problems.  A 
refinement  of  this  approximate  analysis  technique  is 
discussed  by  Sauer  and  Chandy  [98],  wno  concentrate  on 
central-server  models. 

In  tfce  mid-1960's  Wallace  and  Rosenberg  [108] 
reported  on  BQA  (for  recursive  queue  analyzer) , a computer 
program  designed  to  numerically  solve  the  balance  equations 
resulting  from  Markovian  queuing  networks.  The  relationship 
between  the  procedures  used  in  RQA  and  the  procedures 
presented  in  this  thesis  is  discussed  in  Chapter  III.  In 
[1C8]  Wallace  and  Rosenberg  admit  that  representation  cf  a 
model  in  the  form  of  a matrix  wnich  can  be  used  by  RQA  is 
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tedious.  However,  a aore  recent  paper  by  Irani  and  Wallace 
[55]  describes  an  effort  to  design  another  program  capable 
of  translating  a graphical  description  of  a network  of 
gueues  into  a form  which  can  be  used  by  BQA,  thus  relieving 
this  tedium.  The  author  aas  not  seen  a final  report  oo  this 
effort,  and  it  is  not  clear  from  [55]  that  such  a program 
was  in  existence  at  the  time  the  paper  was  written.  Use  of 
RQA  has  been  reported  by  Smith  [102]  and  Wallace  and  Mason 
[107],  Lavenberg  [75]  has  reported  using  a computational 
method  siailar  to  that  used  in  RQA. 

This  ccmplet.es  the  literature  review.  Attention  is 
new  drawn  to  solution  of  some  of  the  computational  problems 
encountered  in  using  the  Markov  chain  approach  on  networks 
of  gueues.  This  is  the  subject  of  Chapter  II. 
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II.  COMPUTATIONAL  PROBLEMS  IN  MODELING 


This  chapter  addresses  the  computational  problems  which 
arise  when  a network  of  queues  is  modelled  as  a Markov 
chain.  As  ncted  in  Chapter  I,  seme  important  work  aas  been 
acne  in  cases  in  which  local  balance  holds  and  a product- 
form  solution  results.  The  emphasis  in  the  current  chapter, 
and  throughout  the  thesis,  is  on  those  cases  in  which  local 
balance  dees  not  held. 

In  the  first  section  the  basic  model  is  introduced. 

This  model  is  a closed  central-server  model  with  no 
immediate  feedback.  (That  is,  jobs  leaving  a processor  must 
precede  to  a different  processor.)  Although  many  of  the 
techniques  discussed  here  are  applicable  to  more  general 
models,  this  basic  model  serves  as  a focal  point  and  is  not 
devoid  of  useful  application. 

The  first  problem  facing  anyone  who  develops  a Markov 
chain  model  is  the  definition  of  a state  description  which 
contains  the  information  necessary  to  fully  describe  each 
state  and  differentiate  between  states.  This  is  the  subject 
of  the  second  section.  The  vector  representations  presented 
there  are  similar  to  those  found  in  many  references,  fer 
example,  Easkett,  Chandy,  Muntz  and  Palacios  [6].  However, 
the  attempt  of  the  author  to  present  computational 
procedures  which  are  easily  adaptable  to  codes  for  use  on 
high-speed  digital  computers  has  resulted  in  a more  explicit 
definition  of  the  representations  than  is  often  found  in  tne 
open  literature. 

Once  a representation  for  the  states  has  been  chosen. 
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attention  turns  to  development  of  the  equations  of 
statistical  equilibrium,  i.  e.,  the  balance  equations. 

(Note  that  the  concern  here  is  the  long-term  average 
results,  i.  e.,  the  so-called  "steady-state"  results.)  This 
attention  results  in  several  computational  problems,  namely, 
how  to  generate  these  equations,  how  to  store  them,  and 
finally,  how  to  solve  them.  The  first  two  of  these 
questions  are  the  subject  of  section  4.  The  final  question 
is  discussed  in  the  next  chapter. 

It  is  generally  inefficient  (not  to  mention  tedious)  to 
refer  to  the  states  by  their  vector  representations  when 
storing  and  solving  the  balance  equation.  It  therefore 
becomes  useful  to  sequence  the  states  so  that  they  may  be 
referred  to  by  sequence  number.  In  section  3 the 
lexicographic  sequencing  procedure  (so  called  because  of  its 
similarity  to  the  alphabetical  sequencing  of  words  in  a 
dictionary,  or  lexicon)  is  described  and  applied  to  the 
vectors  representing  the  states.  Also  in  this  section  is 
found  explicit  discussion  of  two  related,  and  quite 
difficult,  problems:  storage  of  the  vector  representations 
of  the  states,  and  determination  of  the  sequence  number  of  a 
state  from  its  vector  representation. 

The  final  section  of  this  chapter  contains  a discussion 
of  the  properties  of  the  system  of  balance  equations.  In 
particular,  seme  of  tne  properties  wnich  are  important  in 
choosing  a solution  method  are  pointed  out  and  discussed. 

Most  of  the  concepts  and  computational  procedures 
introduced  in  this  chapter  are  first  presented  in  the 
context  of  a particular  case  of  the  basic  model.  This  case 
is  introduced  in  subsection  1.1  and  is  called  the  "Key 
example"  throughout  the  thesis.  A wide  variety  of 
generalizations  of  the  key  example  are  discussed  in 
subsections  1.2,  2. 2-2.7,  3. 3-3. 9 and  4.2-4. 7.  These 
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subsections  aay  be  omitted  on  a first  reading  to  relieve 
some  of  the  tedium  which  otherwise  results  rather  naturally. 

1.  THE  EASIC  MODEL 

The  basic  model  of  interest  in  this  chapter  is  what  has 

been  called  by  many  authors  a central-server  model.  As 

indicated  in  Figure  1.1  this  model  is  a closed  network  of 

queues  consisting  of  a central  server,  hereafter  called  the 

CPU  (central  processing  unit)  , and  M peripheral  processors 

(hereafter  called  the  EP's),  labeled  PP1 , PP2 , ...  , PPM. 

Any  job,  or  customer,  completing  service  at  cne  of  the  PP's 

is  routed  directly  to  the  CPU.  Any  job  completing  service 

at  the  CPU  is  routed  directly  to  one  of  the  PP's.  The 

choice  of  PP  in  this  latter  case  depends  upon  a probability 

distribution  (p  } and  is  independent  of  previous  choices, 
i 

The  individual  probabilities  in  this  distribution  are  termed 
branching  probabilities. 

Being  a closed  network,  the  number  of  jobs  circulating 
amcng  the  M+ 1 processors  is  fixed.  We  will  use  N to  denote 
this  number. 

As  indicated  by  the  terminology  used  here,  the  author  is 
interested  in  models  which  are  approximations  of  computer 
systems.  This  should  not  detract  from  the  fact  that  the 
concepts  and  techniques  discussed  in  these  pages  are 
developed  for  networks  of  queues  and  not  just  models  of 
computer  systems.  Many  other  systems  could  be  modeled  as 
queuing  networks,  some  even  as  central-server  models. 

The  closed  central-server  models  discussed  in  this 
chapter  are,  at  best,  approximations  of  computer  systems. 
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Ihis  is  nest  cbvious  from  the  fact  that  the 
is  fixed.  However,  as  discussed  by  Gordon  and  Newell  [46] 
and  others,  many  open  queuing  networks  can  be  reformulated 
as  closed  networks.  Also,  the  central-server  model  can  be 
used  as  a submodel  in  a model  which  allows  the  number  and 
composition  of  jobs  in  the  system  to  vary. 

The  model  described  above  is  very  general.  For  example, 
as  indicated  in  subsection  2.3,  multiple  (identical)  CPU's 
can  be  modeled  as  a single  multiserver  CPU.  Most  of  the 
techniques  discussed  are  applicable  to  more  general  queuing 
networks,  as  hinted  at  in  subsection  1.2.  Seme  of  the 
reasons  for  considering  closed  central-server  models  are 
given  at  the  end  of  section  5. 

Throughout  this  chapter  a particular  example  is  used  to 
introduce  and  illustrate  the  various  concepts  and 
techniques.  The  generality  of  these  concepts  and  techniques 
are  then  discussed  in  terms  of  generalizations  of  this  key 
example . 

1.1.  The  Kex  Example 

For  the  key  example  all  service  times  are 

exponentially  distributed  and  all  queuing  disciplines  are 

FCF 5 . Two  types  of  jobs,  N of  type  one  and  N = N - N of 

1 2 1 

type  two,  circulate  in  the  system.  The  service  rate 

(reciprocal  of  mean  service  time)  at  each  queue  and  the 
branching  probabilities  depend  upon  job  type.  RATE  (I,  J) 
denotes  the  service  rate  of  a type-I  job  (I  = 1,2)  at 
processor  J (J  = 1 ,2  , . . . , M+ 1 ) , where  processor  J is  the  CPU 
if  J = M 1 and  PPJ  if  J < a+1.  ALFA  (I, J)  denotes  the 
prebaoility  that  a type-I  job  (I  = 1,2)  routes  to  PPJ  (J  = 
1,2,. ..,S)  after  completion  of  service  at  the  CPU.  Each 
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queue  has  only  one  server. 

Ihe  key  example  as  described  here  is  the  model 
discussed  by  Gaver  and  Humfeld  [39].  The  development 
presented  here  is  similar  to  that  used  in  [39],  although  no 
qener alizaticns  are  discussed  there. 

1.2.  Generalizations 


At  this  point  generalization  of  the  number  of  job 
types  is  obvicus.  If  K is  the  number  of  job  types,  let  N 

k 

be  the  number  ' type-k  jobs  in  the  system  for  k = 1,  2, 

....  K and  make  the  restriction  that  N + N ♦ ...  ♦ N = N. 

1 2 K 

The  rate  matrix  SATE  (I, J)  and  the  brancning  probaoility 
matrix  ALTA  (I, J)  would  be  expanded  to  allow  I to  become  as 
large  as  K. 

Generalization  of  the  service  distributions  to 
include  generalized  Erlangian  distributions  would  involve 
addition  cf  another  dimension  to  the  rate  matrix  to  indicate 
stage  of  service.  For  example,  we  might  use  HATE(I,J,I)  to 
denote  the  rate  parameter  associated  with  the  L-th  stage  of 
service  for  type-I  jobs  at  the  J-th  processor.  In  addition 
it  would  be  necessary  to  provide  another  matrix  to  indicate 
the  probability  of  completing  service  at  the  processor  with 
completion  at  each  stage  of  service. 

Here  that  the  form  of  the  network  itself  may  also  be 
generalized.  Ey  adding  another  dimension  tc  the  branching 
probability  matrix,  consideration  may  be  given  to  the  most 
general  type  of  queuing  network.  For  example, 

ALT  A (I , J , l , J • ) might  be  used  to  denote  the  probability  of  a 
type-I  jet  routing  to  processor  J after  completing  the  L-th 
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stage  of  service  at  processor  J' 


Other  generalizations  will  be  discussed  in  the 
following  sections. 

2.  STATE  DESCRIPTIONS 


Note  that  the  structure  of  the  key  example  involves 
Markov-like  assumptions.  In  particular,  service  times  are 
exponentially  distributed  (memoryless)  and  choice  of  PE  to 
route  to,  following  service  at  the  CPU,  is  independent  of 
choices  that  may  have  teen  made  earlier.  Indeed,  it  is 
exactly  these  assumptions  which  allow  the  construction  of 
the  balance  equations  and  the  solution  for  steady  state, 
both  in  the  key  example  and  in  numerous  generalizations. 

Nonetheless,  sc  long  as  there  is  at  least  one  processor 
to  which  jobs  cf  more  than  one  type  can  route,  at  which 
different  types  cf  jobs  receive  service  at  different  rates, 
and  which  has  a FCES  queuing  discipline,  a simple 
compilation  cf  numbers  of  jobs  present  at  each  processor 
does  not  define  a Markov  process.  Even  an  extension  tc 
specify  the  number  of  jobs  of  each  type  present  at  eaca 
processor  will  not  define  a Markov  process. 

To  see  that  this  is  true,  consider  the  key  example  in 
which  the  CPU  is  a processor  of  the  type  described  in  the 
preceding  paragraph.  The  probability  of  leaving  a state  in 
the  time  interval  (t,t+dt),  given  that  the  system  is  in  that 
state  at  time  t (a  quantity  needed  in  development  of  the 
Kolmogorov  differential  equations  and  subsequently  the 
balance  equations) , is  equal  to  a sum  of  terms  one  of  which 
is  proportional  to  service  rate  at  tne  CPU  for  the 
particular  jee  type  in  service  there.  Thus,  it  is  necessary 
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to  know  which  type  of  job  is  in  service.  Further  reflection 
concerning  what  needs  to  be  known  in  order  to  develop  the 
Kolmogorov  differential  equations  and  the  balance  equations 
reveals  that  the  order  in  which  the  types  of  jobs  arrived  at 
the  CPU,  cr  eguivalently  the  order  in  which  the  types  of 
jots  currently  at  the  CPU  will  receive  service  there,  must 
be  known. 


2.1.  Key  Example 

For  the  present  assume  that  ALFA  (I, J)  is  positive 

for  I = 1,2  and  J = 1,  2,  ...»  M.  That  is,  assume  that  any 

jot  can  visit  any  given  processor  in  the  course  of  its 

travels.  Then  as  discussed  above,  to  specify  a state  it  is 

necessary  to  specify  the  order  of  job  types  at  each 

processor.  Towards  this  and  consider  a state  vector  of 

length  N ♦ M . The  first  N components  of  the  state  vector 

consist  of  seme  arrangement  of  N "ones"  and  N "twos" 

1 2 

representing  the  N type-cne  jobs  and  N type-two  jobs  in 

1 2 

the  system.  For  J = 1,  2,  ...,  H component  N + J enumerates 

the  jobs  at  EEJ.  Hereafter  this  vector  representation  is 

termed  I5IAIE.  Now  suppose  that  for  each  J = 1,  2,  ...,  M , 

1ST  ATS  ( N+J)  = L . Then  tae  following  conventions  are 
«J 

followed : 

(i)  The  first  L components  of  ISTATE  represent 

the  jobs  at  PP 1 , the  next  L components  represent 

2 

tae  jobs  at  PE2,  ...,  the  next  L components 

H 

represent  the  jobs  at  PPM,  and  the  remaining 

components  (of  the  first  N)  represent  the  jobs  at 
the  CPU. 
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(ii)  The  components  of  ISTATE  representing  jobs  at 
a given  processor  are  listed  in  the  reverse  of 
their  order  of  arrival  (the  line  forms  to  the 
left),  and  hence,  in  the  reverse  of  their  order  of 
service  at  that  processor.  In  particular,  the 
rightmost  component  is  the  type  of  job  in  service 
at  that  processor. 


Example  2.1 


Let  N = 3,  N =4  and  M = 2.  Then  N = 7 and  ISTATE 

1 2 

must  have  length  N ♦ M = 9.  Consider  ISTATE  = 

{ 2, 1, 2 , 1 ,2 , 2 , 1 , 3, 2} . Note  that  there  are  L ^ =3  jobs  at  PP  1 , 

L =2  jcbs  at  PP2  and  N - L - L =2  jobs  at  the  CPU. 

2 12 

This  is  emphasized  in  the  following  diagrammatic 
representation  cf  this  state  vector. 


jobs  at  PP1 joes  at  P P 2 jobs  at  CPU L 


2 1 2 


1 2 


2 1 


At  PP 1 a type-two  job  is  in  service,  a type-one  job  will 
enter  service  next,  and  a type-two  job  will  enter  service 
after  these  ethers  have  completed  service.  At  PP2  a type-two 
job  is  in  service  followed  by  a type-one  job.  At  the  CPU  a 
type-one  job  is  in  service  followed  by  a type-two.  jcb 


Example  2.2 

4,  M = 3 and  ISTATE  = 

This  is  represented  diagrammat ically 


Let  N = 3,  N = 

1 2 

{2, 1,2, 1,2,2, 1,0, 0,0}  . 


by : 
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at_PPl 


at  PP 2 at_?P3 


-j9bs  at  CPU I 

2, 1,2, 1,2,2, 1 0 0 C 


All  jobs  are  at  the  CPU.  A type-one  job  is  in  service.  The 
next  six  jobs  to  enter  service  at  the  CPU  will  be  of  types 
two,  two,  one,  two,  one  and  two  respectively. 


Example  2.3 


that 


Suppose  N = 3,  N =4  and  M = 5.  Suppose  further 

12 

it  is  observed  that  there  are  two  type-two  jobs  at  PP2, 


twc  type-cne  jobs  at  PP4 , and  all  other  PP's  are  idle.  Then 
the  ISTATE  vector  representation  of  the  current  state  cf  the 
system  is 

ISTATE  = [2, 2, 1 , 1 ,2 ,2, 1 , 0 , 2,0,2 , 0}  if  a type-one 
job  is  in  service  at  the  CPU; 

ISTATE  = {2/ 2 , 1 , 1 ,2 , 1 , 2 , 0, 2,0,2 , 0}  if  the  type-one 
job  will  enter  service  at  the  CPU  after  the 
current  jcb  completes  service  there;  or 
ISTATE  = {2,2,1,1,1,2,2,0,2,0,2,0}  if  the  type-one 
job  will  enter  service  at  the  CPU  only  after  both 
other  jobs  there  have  completed  service. 
Digrammatically,  these  three  states  may  be  represented  as 
fellows: 

£PJ |P2 PP3 PP4 PP  5 CPU L 1^ 


2,2  1,1 

2,2, 

1 0 2 

0 2 

0 

2,2  1,1 

2,  1, 

2 0 2 

0 2 

0 

2,2  1,1 

1,2, 

2 0 2 

0 2 

0 

In  view  of  Example 

2.3  it  is 

evident 

that  any 

state 

of  the  system  can  be  represented  in  terms  of  an  ISTATE 
vector.  If  ALFA  (I, J)  is  positive  for  I = 1,2  and  J = 1,  2, 
...,  a,  then  a different  state  is  represented  by  each  ISTATE 
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vector  satisfying  the  following  rules: 


Rule  1:  The  length  of  ISTATE  is  N + (I. 

Rule  2:  The  first  N components  of  ISTATE  consist 

of  N cnes  and  N twos  in  some  order. 

1 

Rule  3:  Each  of  the  last  a components  of  ISTATE 
is  a ncn-negative  integer.  The  sum  of  these  M 
integers  is  no  larger  than  N. 

If  ALFA  (I, J)  = 0 for  some  I and  J,  seme  of  the 
ISTATE  vectors  satisfying  these  three  rules  will  not 
correspond  tc  feasible  states.  For  example,  if  ALFA  (1,1)  = 
0,  any  ISTATE  vector  which  has  L = ISTATE  (N+1)  > 0 and 

which  has  a cne  among  the  first  L components  corresponds  to 

an  infeasible  state.  Such  cases  may  be  handled  in  a number 
of  ways,  seme  of  which  will  be  discussed  in  the  coming 
sections . 

2.2.  Generalization  of  Number  of  Job  Types 


Ii  there  are  K job  types  and  N jobs  of  type  k fer  k 

k 

= 1,  2,  ...,  K,  then  all  or  the  above  applies  with  Rule  2 
modified  to  read: 

Rule  2:  Tne  first  N components  of  ISTATE  consist 

of  N cnes,  N twos,  ...,  and  N "K"s  in  some 
1 2 K 

order . 

2.3.  Generalization  of  N upper  of  Servers 


Consider 
a system  with  L 
.ice,  so  that  if 


a model  similar  to  the  key  example  to 
identical  CPUs  but  with  a single  waitin 
more  ♦nan  L jobs  are  at  the  CPUs,  the 


model 

9 

first 
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jot  enqueued  will  te  serviced  at  the  first  available  CEU. 
Then  the  CPU  could  be  modeled  as  a multiserver  queue.  The 
information  necessary  to  specify  a state  is  the  same  as  that 
required  for  the  key  example  except  that  rather  than  tne 
order  of  jobs  in  service  at  the  CPU  we  need  know  only  the 
number  of  jobs  of  each  type  in  service. 

Keeping  this  in  mind,  the  ISTATE  vector  could  te 
reformulated  to  include  the  number  of  jobs  at  each  PP  (M 
components),  the  number  of  each  type  cf  job  in  service  at 
the  CPU  (K  components  if  there  are  K job  types)  and,  in 
appropriate  order,  job  types  for  those  jobs  at  the  PP's  and 
those  jots  enqueued  at  the  CPU.  3ecause  the  number  of  jobs 
enqueued  at  the  CPU  varies  from  state  to  state,  ISTATE  will 
have  variable  length  when  formulated  in  this  manner. 
Computationally  (in  FORTRAN,  for  example)  ISTATE  must  have 
dimension  large  enough  to  accomodate  the  largest  possible 
length.  This  largest  length  is  easily  seen  to  be  N + K ♦ K 
(realized  whenever  there  are  no  jobs  at  the  CPU) . This 
becomes  mere  complicated  as  the  number  of  multiserver 
processors  increases. 

Note,  however,  that  the  same  formulation  for  ISTATE 
as  was  discussed  above  for  the  key  example  can  be  retained 
if  any  information  concerning  multiservers  is  retained 
separately  and  techniques  are  developed  to  computationally 
handle  any  resulting  complications.  Specifically,  these 
complications  are  due  to  the  nonunique  representation  cf 
seme  states  in  terms  of  the  ISTATE  vector.  The  following 
example  illustrates  this  point. 


Example  2.4 


Let  K 


2,  N 


M =2  and  the  number  of 
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servers  at  the  CPU,  L = 2.  Then  the  state  with  both  jcos  at 

the  CPU  (and  therefore  both  jobs  in  service  at  the  CPU)  is 
represented  by  both  ISTATE  = {1,2, 0,0}  and  ISTATE  = 

{2, 1,0,0} . 

The  single  server  processors  discussed  earlier  can 
be  considered  as  a special  case  of  the  multiserver 
processor.  However,  a more  interesting  special  case  is  the 
infinite  server  (IS)  queue  as  introduced  in  subsection  4.3 
of  Chapter  I.  In  the  context  of  closed  networks  of  queues 
where  the  total  number  of  jobs  is  limited,  the  number  of 
servers  may  not  be  truely  infinite.  Rather  it  is 
sufficiently  large  to  simultaneously  accomodate  all  jots 
which  may  visit  the  queue.  In  this  sense,  the  CPU  is  an  IS 
queue  in  Example  2.4. 

2.4.  Generalization  of  Queuing  Discijqline 

(The  queuing  disciplines  referred  to  here  are 
discussed  in  seme  detail  in  the  second  section  of  Chapter 
I.) 

For  all  of  the  disciplines  discussed  here,  the 
structure  of  the  ISTATE  vector  as  originally  introduced 
contains  all  required  information.  Although  special 
reformulations  which  contain  the  required  information  in  a 
more  explicit  form  are  possible  in  most  cases,  problems 
similar  tc  those  discussed  above  for  multiserver  queues 
arise.  As  a result  the  author  feels  that  it  is  advisable  to 
retain  the  current  structure  of  the  ISTATE  vector  and  handle 
computationally  any  resulting  complications. 

LCFS:  The  information  required  is  exactly  the  same 

as  that  required  for  FCFS.  However,  the  enqueued  jobs  are 

I 
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listed 
la  this 
service 
receive 


in  their 
way  the 
and  the 
service 


crder  of  arrival  rather  than  the  reverse, 
rightmost  job  is  still  the  one  receiving 
rightmost  engueued  job  is  still  the  next  to 
when  a server  is  availaDle. 


Ncnpreempti ve  priority:  If,  for  example,  type-one 
jobs  have  higher  priority  than  type-two  jobs  at  certain 
queues  then  the  jobs  enqueued  at  those  queues  must  be  listed 
so  that  all  ones  are  to  the  right  of  all  twos. 


Preemptive  priority:  Again,  if  type-one  jobs  nave 
higher  priority  than  type-two  jobs,  then  all  jobs  at  such 
processors  must  be  listed  so  that  all  ones  are  to  the  right 
of  all  twos. 


ICPSEfi  and  LCPSPHpt:  Ail  jobs  at  such  processors 
must  be  listed  in  tne  order  of  their  arrival  with  rightmost 
job  being  the  most  recently  arrived  job.  If  the  processor 
has  a nonexponential  service  distribution,  as  discussed 
below,  the  stage  of  service  stored  for  enqueued  jobs  is  the 
stage  the  jot  was  in  when  interrupted  in  the  LCFSPR  case  and 
the  highest  stage  attained  by  the  job  since  last  leaving  the 
processor  in  the  LCFSPRpt  case.  Additional  components  for 
each  server  at  each  LCFSPRpt  processor  are  required  to 
record  the  current  stage  of  service  for  each  job  in  service. 

PS:  Ihe  order  of  the  jobs  at  such  processors  is 
immaterial.  This  will  be  discussed  more  fully  in  the  coming 
sections,  but  the  meaning  of  this  statement  is  clarified  in 
the  following  example. 


Example  2.5 


Let  K = 2,  N 

1 


2,  N = 2,  M =2  and  suppose  that  the 


85 


1 


CEO  has  a PS  discipline.  Then  the  following  six  ISTAIE 


vectors  represent  the  same  state: 

11,1,2,2,0,0}  12,1,1,2,0,0} 

11,2,1,2,0,0}  12,1,2,1,0,0} 

11,2,2,1,0,0}  12,2,1,1,0,0} 

2.5.  Generalization  of  Service  Distributions 

Consider  modification  of  the  key  example  to 
incorporate  generalized  Erlangian  service  distributions  for 
cne  or  more  types  of  jobs  at  one  or  more  of  the  processors. 
Then  at  least  for  those  types  of  jobs  having  nonexponeatial 
distributions  and  at  those  processors  where  these 
distributions  apply,  it  will  be  necessary  tc  include  in  any 
state  description  tne  stage  of  service.  (See  Example  1. 1 in 
Chapter  I.)  If  all  processors  have  non-preemptive  queuing 
disciplines,  this  may  be  accomplished  by  adding  il  * 1 
components  to  the  I5TATE  vector  (assuming  each  processor  has 
a single  server  and  none  nave  a PS  queuing  discipline)  and 
using  these  tc  store  the  stage  of  service  for  the  job  in 
service  at  the  M ♦ 1 processors.  (Of  course,  fewer  than  h + 
1 components  need  to  be  added  if  one  or  more  processors  have 
only  exponentially  distributed  service  times.  Furthermore, 
more  than  M + 1 components  may  be  required  if  one  or  more 
processor  has  multiple  servers  or  a PS  queuing  discipline.) 
If  cne  or  mors  processors  aas  a preemptive  service 
distributicc,  N components  should  be  added  to  ISTATE  tc 
record  the  stage  of  service  for  eaca  of  the  N jobs  in  the 
system.  This  number  should  not  te  reduced  for  reasons 
similar  tc  those  discussed  under  multiple  server  queues 
above . 
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2.6.  Finite  Capacities  and  B loc icing 

Consider  the  key  example  with  the  following  change: 
The  CPU  has  a finite  capacity,  C.  That  is,  if  there  are  C 
jets  at  the  CPU  (in  service  and  enqueued)  and  a job 
completes  service  at  one  of  the  PP's,  rather  than  routing  to 
the  CPU  the  job  stays  at  the  PP  blocking  other  jobs  enqueued 
there  from  receiving  service.  When  a joo  subsequently 
completes  service  at  the  CPU  and  routes  to  one  of  the  PP's, 
a job  will  simultaneously  route  from  one  of  the  blocked  PP's 
to  the  CPU,  allowing  tne  next  job  (if  any)  enqueued  at  that 
PP  to  begin  service. 

Such  models  can  be  handled  using  the  techniques 
discussed  in  this  taesis  if  some  procedure  is  specified  for 
determining  which  PP  will  ae  undocked  by  a service 
completion  at  the  CPU  if  more  than  one  PP  is  blocked. 

Options  for  such  procedures  include: 

(i)  Priority  scheme:  e.g.,  PP1  is  unblocked 
before  PP2 , which  is  in  turn  unblocked  before  PP  3 , 
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(ii)  Probabilistic  scheme:  e.g.,  having  assigned 

a positive  number  Q to  PPi  for  i = 1,  2,  ...»  M, 

i 

the  probability  that  PPj  is  tne  one  unblocked 

(given  that  it  is  blocked)  is  equal  to  £ divided 

D 

by  the  sum  of  the  Q 's  over  all  blocked  PP's.  The 

i 

■I  's  are  relative  priority  numbers  in  that  PPi  is 
i 

twice  as  likely  to  be  unblocked  as  PPj  if  botn  are 
blocked  and  Q is  twice  as  large  as  Q . 


(iii)  A 
priority 


l 

combination 
is  given  to 


of  (i)  and  (ii)  : e.g 
the  PP  to  wnich  the 


•r  f 

job 


irst 


* 
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completing  service  at  the  CPU  routes;  if  this  PP 
is  not  blocked,  each  of  the  blocked  PP's  are 
equally  likely  to  be  the  first  unblocked. 

(iv)  FIFO  scheme:  i.e.,  the  PP  which  has  been 
blocked  the  longest  (or  shortest  for  a LIFO 
scheme)  is  the  one  unblocked. 

whatever  the  scheme,  tne  model  can  probably  be 
handled  by  addition  to  IS  FATE  of  an  additional  component  for 
each  P?  specifying  its  blocked/not  blocked  condition.  In 
the  priority  and  probabilistic  schemes  (and  combinations  of 
them)  this  component  can  be  set  equal  to  one  when  the  EP  is 
blocked,  and  equal  to  zero  otherwise.  In  a FIFO  (or  LIFO) 
scheme  the  value  taken  on  by  this  component  should  indicate 
its  relative  position  among  the  blocked  PP's.  For  example, 
it  may  be  set  equal  to  zero  if  the  ??  is  not  blocked,  one  if 
it  has  been  blocked  longer  than  any  other  blocked  PP,  two  if 
only  one  PP  has  been  blocked  longer,  etc. 

If  cne  or  more  of  the  PP's  is  a multiserver  queue 
and  a priority  or  probabilistic  scheme  is  used,  the 
blccked/nct  blocked  component  can  be  used  to  indicate  the 
number  of  servers  blocked.  In  such  cases,  the  order  of  the 
job  types  in  ISTATE  for  a multiserver  PP  should  be  those 
enqueued  followed  by  those  being  served  followed  by  these 
blocked. 

If  cne  or  more  of  the  PP's  (rather  than  the  CPU)  has 
finite  capacity,  a component  should  be  added  to  ISIATE  for 
each  server  at  the  CPU.  (The  CPU  is  assumed  to  not  have  a 
PS  discipline.)  In  this  case  the  component  corresponding  to 
a given  server  should  tell  which  PP  is  causing  blockage  of 
that  server. 

If  cne  or  more  PP's  and  tne  CPU  have  finite 
capacity,  care  should  be  taken  that  it  is  not  possible  to 
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deadlock  the  system  by  having  the  CPU  blocked  waiting  for  a 
vacancy  at  seme  PP  and  having  that  same  PP  blocked  waiting 
for  a vacancy  at  the  CPU.  If  such  a state  is  feasible,  it 
is  an  absorbing  state  and  the  resulting  steady-state 
conclusicns  are  predictable.  (For  more  on  deadlocking,  the 
reader  is  referred  to  Havender  [49].) 

2.7.  Bulking 

Another  phenomenon  which  can  be  handled  using  the 
techniques  discussed  in  this  thesis  is  bulking.  3ulking 
occurs  when  jobs  (possibly  of  a given  type)  are  required  to 
leave  a given  processor  in  groups  of  two  or  mere.  For 
example,  if  type-two  joos  must  route  from  the  CPU  in  groups 
of  three,  a type-two  job  completing  service  there  will  enter 
a hulking  queue  if  no  more  than  one  other  type-two  job  is  in 
the  bulking  queue  or  will  route  with  two  other  type-twc  jobs 
(both  from  the  bulking  queue)  to  one  of  the  PP's.  To  handle 
bulking  it  is*  necessary  to  add  one  component  to  I5TATE  for 
each  processor  at  which  bulking  occurs.  This  component  will 
hold  tae  numoer  of  joas  in  the  bulking  queue  for  that 
processor.  The  order  of  job  types  in  ISTATE  for  a processor 
at  which  bulking  can  occur  should  be  (from  the  left)  those 
enqueued  for  service,  those  being  served  and  those  in  the 
bulking  queue. 

3.  STORAGE  AND  SEQUENCING  OF  STATES 

In  the  next  section  it  will  be  shown  that  the  ISTATE 
vector  form  cf  state  representation  lends  itself  readily  to 
generation  cf  the  balance  equations.  However,  informative 
as  this  representation  is,  and  as  important  as  it  may  be  in 
generation  cf  the  balance  equations,  there  are  some 
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important  reasons  for  sequentially  numbering  the  states; 
i.e.,  assigning  to  each  state  a name,  its  state  number,  from 
among  the  positive  integers  so  that  it  may  be  referred  to 
directly  without  reference  to  a lengthy  string  of  numbers. 


1 


First,  when  properly  sequenced,  the  states  may  be 
considered  one  at  a time  without  fear  of  inadvertently 
emitting  cr  repeating  states.  This  is  important  since 
several  passes  through  the  entire  list  of  states  is  required 
to  generate  the  balance  equations,  solve  them  for  the 
steady-state  probability  distribution,  and  from  this 
distribution  calculate  the  desired  measures  cf  system 
performance . 


Second,  storage  of  the  balance  equations  is  considerably 
mere  efficient  if  done  in  terms  of  the  state  numbers  rather 
than  the  vectors.  Each  balance  equation  involves  reference 
to  at  least  two  states  and,  in  many  cases,  more.  Consider  a 
balance  equation  referencing  five  states  in  a model  in  which 
there  are  seven  jobs  (N  = 7^and  three  PP*s  (M  = 3).  The 
state  numbers  for  this  balance  equation  would  require  five 
storage  spaces;  the  state  vectors  would  require  fifty.  If, 
for  example,  all  processors  were  modeled  as  FCFS  single 
server  queues  (the  ke y example)  and  the  seven  jobs  were  six 
of  one  type  and  one  of  another,  then  five  is  about  the 
average  number  of  references  for  each  of  the  840  oa lance 
equations.  So  the  advantage  in  this  case  is  storage  of 
about  42CC  numbers  as  compared  to  42,000. 

Third,  tc  solve  the  balance  equations  it  is  not 
necessary  to  know  anything  about  the  individual  states.  All 
that  is  required  is  a way  of  differentiating  between  the 
states.  Sequential  numbering  of  the  states  provides  net 
only  this  capability,  but  also  a convenient  way  to  proceed 
through  the  balance  equations  while  computing  a solution. 
(That  is,  in  a FOETEAJi  program  we  will  be  allowed  to  use  a 
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"DC  loop.") 


As  is  evident  from  the  above  paragraphs,  the  balance 
equations  should  be  stored  in  terms  of  the  state  numbers. 
However,  the  information  contained  in  the  vector 
representation  is  required  to  generate  the  balance 
equations.  Hence,  a procedure  is  required  for  efficient 
determination  of  the  state  number  from  its  vector 
representation.  The  problems  of  sequentially  numbering  the 
states,  storing  their  vector  representations  and  determining 
the  state  number  from  the  vector  representation  are 
interconnected  and  will  be  considered  simultaneously. 

3.1.  Lexicographic  Sequencing  of  Integer  Vectors 


The  techinque  which  leads  to  useful  sequencing  of 
the  ISTATE  vectors  is  constrained  lexicographic  ordering. 
This  technique  has  long  been  used  in  mathematical  analysis 
as  a means  of  proving  that  the  rational  numbers  in  the 
interval  (0,1)  are  countable.  It  has  also  been  useful  in 
enumeration  algorithms  for  integer  programs. 

Ihe  basic  procedure  for  constrained  lexicographic 
sequencing  of  integer  vectors  is  summarized  in  the  following 
steps: 

(i)  To  get  the  first  vector,  start  with  the 
leftmost  component  and  successively  set  each 
component  equal  to  the  smallest  number  which  will 
yield  a vector  satisfying  the  constraints. 

(ii)  Each  successive  vector  is  derived  from  its 
predecessor  by  increasing  the  value  of  one  of  the 
components  and  successively  setting  each  component 
to  its  right  equal  to  the  smallest  number  which 
will  yield  a vector  satisfying  the  constraints. 

In  each  case  the  component  increased  is  the 
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rightmost  component  which  can  be  increased  without 
violating  the  constraints.  The  number  to  which  it 
is  increased  is  the  smallest  number  (larger  than 
its  previous  value)  which  will  satisfy  the 
constraints. 

A more  detailed  version  of  this  procedure  is  presented  in 
Algorithm  1 in  Appendix  B. 

The  constraints  referred  to  here  vary  from  problem 
to  problem.  In  gereral,  they  are  equivalent  to  the 
characteristics  of  the  vectors  to  be  sequenced.  In  the  case 
of  integer  programs,  the  constraints  of  the  program  are  the 
ones  referred  to  above.  Ihe  following  example  -hows  hew 
constrained  lexicographic  sequencing  of  integer  vectors  is 
used  to  prove  that  the  rational  numbers  in  the  interval 
(0,1)  are  countable.  In  doing  so  it  not  only  exemplifies 
the  use  cf  the  procedure  outlined  above,  but  also  clearly 
sets  forth  the  constraints  and  shows  their  relationship  to 
the  character  of  the  vectors  sequenced. 


Example  2.6 

In  order  to  prove  tnat  there  are  a countable  number  of 
rationals  netween  zero  and  one,  it  is  necessary  to  exhibit  a 
mapping  frem  the  counting  numbers  onto  the  set  of  rational 
numbers  in  (0,1).  (See  Halmos,  [48].)  In  ether  words, 
these  rational  numbers  must  be  sequenced  so  that  given  any 
particular  rational  number,  r,  some  counting  number,  i,  may 
be  determined  such  that  r is  the  i-th  number  in  the 
seguence . 

Toward  this  end  recall  that  a rational  number  is  the 
ratio  a/b  of  two  integers.  Since  the  goal  is  to  sequence 
the  rationals  in  (0,1) , a and  b may  be  assumed  positive  with 
a < b.  Now  consider  the  set  of  all  vectors  (b,a]  with  a and 
b positive  integers  and  a < b.  Since  such  a vector  can  be 
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found  for  each  rational  number  in  (0,1),  and  since  each  such 
vector  can  correspond  to  only  one  rational  number  in  (0,1), 
the  proof  is  complete  if  the  vectors  can  be  sequenced.  In 
mathematical  terms,  the  mapping  which  takes  {b,a}  to  a/b  is 
a mapping  frcm  the  set  of  all  positive  integer  pairs  {t,a} 
such  that  a < fc  onto  the  set  of  rational  numbers  in  (0,1). 
This  mapping  composed  with  the  mapping  of  the  counting 
numbers  onto  the  set  of  such  integer  pairs  (represented  by 
the  sequencing  of  these  pairs)  yields  a mapping  of  the 
counting  numbers  onto  the  set  of  rational  numbers  in  (0,1). 
Exactly  how  this  works  will  be  clarified  after  the  above 
procedure  has  been  used  to  sequence  the  vectors. 

First  the  constraints  must  be  derived.  If  (b, a]  is  a 
"valid"  vector  (that  is,  one  of  the  vectors  to  be 
sequenced),  then  a and  d are  positive  integers  and  a < b. 
Thus,  the  constraints  to  be  used  in  the  sequenceng  procedure 
are : 

Rule  1:  a and  b are  positive  integers. 

Rule  2:  a < b. 

Now  that  the  constraints  have  been  specified,  the 
procedure  outlined  above  can  be  used  to  sequence  the 
vectors.  The  first  vector  is  determined  using  step  (i) . 
According  to  this  step,  the  components  are  determined  from 
left  to  right.  That  is,  first  b and  then  a will  be 
determined.  Furthermore,  each  component  will  be  set  equal 
tc  its  smallest  feasible  value.  3y  Rule  1 this  value  is  one 
for  both  a and  b.  However,  Rule  2 restricts  b to  be  larger 
than  a.  Thus,  the  smallest  value  of  b which  will  lead  to  a 
valid  vector  is  two.  The  cnoice  for  a is  necessarily  one 
and  the  first  vector  is  (2,1}. 

Having  found  the  first  vector,  the  second,  third, 
fourth,  and  sc  forth  vectors  are  determined  by  successive 
application  cf  step  (ii) . In  determining  the  second  vector, 
note  that  increasing  a will  violate  Rule  2.  Thus,  let  b = 3 
and  set  a equal  to  the  smallest  value  which  yields  a vector 
satisfying  the  constraints.  The  second  vector  is  seen  to  be 


{3,1}.  The  value  of  a can  be  increased  to  derive  the  third 
vector:  {3,2}.  Step  (ii)  is  used  successively  to  generate 

the  remaining  vectors:  {4,1},  {4,2},  {4,3},  {5,1},  {5,2}, 

• • • 

To  determine  the  sequence  number  of  a particular 
rational  number,  r,  in  (0,1),  first  find  positive  integers  a 
and  b such  that  r = a/b.  Then,  r is  the  i-tn  rational  (more 
formally,  i gets  mapped  onto  r)  if  {b,a}  is  the  i-th  vector. 
For  example,  if  r = .375,  r = 3/8  and  r is  seen  to  be  the 
24-th  rational  number  according  to  this  sequencing 
procedure. 

Note  that  in  this  example  each  rational  number  in 
(0,^)  has  more  than  one  (in  fact,  an  infinite  number)  of 
sequence  numbers.  For  example,  r = .375  is  not  only  the 
24-th  rational,  but  also  the  111-th  (r  = 6/16)  and  the 
1977-th  (r  = 24/64) . 

Cn  the  other  hand,  each  "valid"  vector  has  a unique 
sequence  number.  This  fact  is  important  in  the  applications 
of  interest  in  this  thesis.  In  these  applications  each 
state  of  a system  is  denoted  by  a unique  integer  vector. 
Using  the  lexicographic  sequencing  procedure  outlined  aoove, 
these  vectors  are  sequenced.  The  sequence  numbers  are 
called  state  numbers  and  are  used  in  storage  of  the  balance 
equations.  It  is  important  that  each  state  has  only  one 
state  number,  so  that  inadvertent  repetition  of  states  may 
be  avoided. 

Cf  course,  it  is  also  important  to  avoid  inadvertent 
omission  cf  states.  This  is  done  by  carefully  choosing  the 
vector  representation  and  the  constraints  sc  that  each  state 
is  ur.iguely  defined  by  a vector  satisfying  the  constraints 
and  each  vector  satisfying  the  constraints  describes  a 
unique  state.  In  section  2 the  ISTATE  vector  representation 
was  introduced  for  the  <ey  example  and  a variety  of 
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generalizations.  Referring  to  subsection  2.1,  the 
constraints  to  be  used  in  the  lexicographic  sequencing  of 
the  ISTATE  vectors  for  the  icey  example  are: 

ISTATE  Sequencing  Constraints 
Rule  1:  The  first  N components  contain  N ones 

and  N twos. 

2 

Rule  2:  The  remaining  f!  components  are 
nonnegative  integers  whose  sum  is  no  larger  than 
N. 

The  following  example  illustrates  the  application  of  the 
lexicographic  sequencing  procedure  to  the  ISTATE  vectors  for 
a particular  case  of  the  key  example. 


Example  2.7 


Consider  the  kev  example  with  N = 2,  N =2  and  M = 

1 2 

2.  The  following  table  shows  27  of  the  90  states  with  their 

corresponding  state  numbers  as  provided  by  the  lexicographic 
ordering  procedure  above  applied  to  the  ISTATE  vectors.  The 
entries  in  the  column  labeled  NS  are  the  state  numbers. 


NS 


1 

2 

3 

4 

5 

6 

7 

8 
9 


NS 


ISTATE 


1 » 1 »2,2,0,0 

10 

[i,  1,2, 2,2,  o; 

19 

[1,2,  1, 2,0,3} 

1,  1,2, 2,0, 1 

1 1 

'1,  1,2, 2, 2,1 

29 

[1,2,  1,2,3,  11 

1,1, 2,2, 0,2 

12 

Li, 1,2, 2, 2, 2 

30 

1,2,  1 , 2 ,4  , C 

1,  1,2, i , 0,3 

13 

1,  1,2, 2, 3,0 

3 1 

1,2,2,  1 ,0,0' 

1,1  ,2, 2, 0,4 

14 

1,  1,2, 2, 3, 1 

45 

1,2,2, 1 ,4,0 

1, 1,2,2, 1,0^ 

15 

1,  1,2, 2, 4,0 

46 

2, 1,1, 2, 0,0 

1,1,  2, 2, 1,1“ 

16 

1,2,  1,2, 0,0 

6 1 

'2, 1,2, 1,0,0 

1,1,^,-c,  1,2 

17 

.1,2, 1,2,0,  1 

76 

2,2,  1 , 1 ,0,0' 

{1,1  ,2,2,1  ,3] 

1 8 

1,  2,  1,2, 0,2 

90 

2,2,  1,1  ,4,0} 

Note  that  for  this  example  Rule  1 states  that  the  first  four 
components  must  consist  of  two  1 's  and  two  2's.  Rule  2 
states  that  the  sum  of  the  last  two  components  must  be  no 
larger  tnan  four.  In  setting  up  the  first  state  vector,  the 
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first  twc  components  are  set  equal  to  one  since  by  Rule  1 
this  is  the  smallest  value  these  components  may  take  on. 

Rule  1 new  forces  the  third  and  fourth  components  to  be  set 
equal  to  two.  The  last  two  components  are  both  set  equal  to 
zero,  the  smallest  values  they  can  take  on  and  still  satisfy 
Rule  2.  In  progressing  from  state  to  state;  the  sixth 
component  is  successively  incremented  until  (state  5)  it 
cannot  be  incremented  further  without  causing  violation  of 
Rule  2.  At  this  point  the  fifth  component  is  incremented, 
and  the  sixth  component  is  set  at  its  smallest  feasible 
value.  Successive  states  are  determined  by  again 
incrementing  the  sixth  component.  This  procedure  continues 
until  state  15  where  further  incrementing  either  of  the  last 
twc  components  will  cause  violation  of  Rule  2.  Incrementing 
either  the  third  or  the  fourth  component  will  cause 
violation  of  Rule  1.  So,  to  get  state  16,  the  second 
component  is  incremented,  the  third  and  fourth  components 
are  set  at  the  smallest  values  allowed  by  Rule  1 (one  and 
two  respectively) , and  the  last  two  components  are  set  at 
the  smallest  values  allowed  by  Rule  2.  From  here  the 
procedure  starts  again  to  increment  the  last  component  in 
determining  successive  states. 

Ecr  the  key  example  lexicographic  sequencing  of  the 
ISTATE  vectors  is  convenient,  and  an  efficient  computational 
scheme  can  be  developed  for  determining  the  state  number 
frem  the  vector  representation.  For  the  generalizations 
discussed  earlier  in  this  chapter,  this  same  sequencing 
procedure  could  be  used  if  further  constraints  are  imposed. 
However,  ether  sequencing  procedures  are  found  to  be  more 
convenient  cr  more  appealing  for  some  of  these 
generalizations  and,  at  the  same  time,  no  less  convenient 
for  the  key  example.  Furthermore,  they  allow  computational 
analysis  of  cne  of  the  solution  procedures  (see  Chapter 
III) . If  the  states  are  arranged  according  to  a 
lexicographic  sequencing  of  the  ISTATE  vectors,  similar 
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analysis  is  considerably  more  complicated  and  remains  an 
open  problem  (see  the  conjecture  in  subsection  4.3  of 
Chapter  III.) 

These  other  sequencing  procedures  are  based  on 
lexicographic  ordering  of  vector  representations  which  are 
derived  from  the  ISTATE  representation.  In  this  subsection 
we  will  discuss  one  of  these  other  procedures.  A second 
will  be  discussed  after  the  problem  of  storage  of  the  stares 
has  been  considered. 

Consider  splitting  the  ISTATE  vector  representation 
of  a state  intc  two  parts.  (This  will  be  found  to  be  a 
useful  idea  when  we  discuss  storage  of  the  states  in  the 
next  subsection.)  The  first  N components  will  be  referred 
tc  as  the  left  subvector  and  the  last  M as  the  right 
sufcvector.  The  ISTATEml  (ml  stands  for  modification  one) 
vector  representation  of  the  state  is  a (row)  vector  of 
length  N + M + 1 whose  first  component  is  the  sum  of  the 
components  of  the  right  subvector  (i.e.,  the  total  number  of 
jobs  at  the  PP's) , whose  next  M components  fcrm  the  right 
subvector,  and  wnose  last  a components  form  the  left 
subvector.  The  constraints  used  in  the  lexicographic 
ordering  procedure  for  these  vectors  are: 

ISTATEml  Sequencing  Constraints 
Hule  1:  The  first  component  is  a nonnegative 
integer  nc  larger  than  N. 

Hule  2:  The  next  21  components  are  nonnegative 
integers  whose  sum  is  the  first  component. 

Rule  3:  The  last  N components  consist  of  N ones 

and  N twos. 

2 


97 


Example  2.8 


Again  consider  the  xev  example  with  N = 2,  N =2  and 

12 

M = 2.  The  following  table  shows  20  of  the  90  states  with 
their  state  numbers  as  provided  by  a lexicographic  ordering 
of  their  ISTATEml  vector  representations.  Both  the  ISTATEml 
and  ISTATE  vector  representations  are  given  for  each  listed 
state . 


ISTATEml 


ISTATE 


' V 4'  V 
, 0,  1 , 2, 
'0,2,1, 
• 1*  ] < 
' I'i'i1 

9 i 9 i 9 i* 
9 i 9 2* 2 4 

± : : 

'3'  ' 1 

» 0 , 2,  2 , 

: : 

,0,2,2, 


1,2,  1 

1,2,2 

2,1,1 

2,1,2 

2,2,1 

1,1,2 

1,2, 1 
>2,2,1 

1,1,2 
2,2,1 
1/1,2 
ri , i ,2 
1,1,2 
{1,1,2 

2,2,1 
1,1  ,2 

■I:):2 

2,; 


The  following  is  a diagrammatic  representation  of  tne 
ISTATEml  vector  representations  of  three  of  the  states.  For 
reference  purposes  the  state  numbers  have  also  been  given. 


L + L L 

~t  2 — r 

2 1 

2 2 

3 0 


at  PP  1 


at  PP2  at  CPU 


1 1 2 


3.2.  Storage  of  the  States 


Cnee  a sequencing  procedure  has  been  established,  it 
can  be  used  whenever  needed  to  sequentially  generate  the 
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states.  If,  on  the  other  hand,  the  states  could  be 
efficiently  stored,  they  could  be  recalled  from  storage  when 
needed  rather  than  going  through  the  sequencing  procedure 
each  time.  In  addition,  a well-designed  storage  procedure 
can  aid  immeasurably  in  determining  state  numbers  from 
vector  representations. 

Eerhaps  the  simplest  storage  procedure  is  tc  store 

the  vectors  in  an  array,  say  NAME,  so  that  NAME  (i, j) 

contains  the  value  of  the  j-th  component  of  the  ISTATE 

vector  representation  (or  some  other  vector  representation) 

of  state  i.  This  is  easily  seen  to  be  inefficient.  Por 

example,  in  modeling  the  key  example  with  N = 6,  N =1  and 

1 2 

M = 3,  NAME  would  have  to  be  dimensioned  840  by  10, 
requiring  8400  storage  locations. 

Next,  consider  converting  each  vector  into  a single 
number  and  storing  the  numoer.  For  example,  in  the  example 
just  cited  the  state  i whose  ISTATE  vector  representation  is 
{1,1,2,1,1,1,1,3,1,0},  could  be  stored  in  NAME(i)  as 
43101121111  (from  the  ISTATEal  vector  representation)  cr 
112111131C  (from  the  ISTATE  vector  representation).  This 
procedure  appears  to  require  only  one  storage  location  per 
state.  However,  there  is  a limit  to  the  number  of  digits  an 
integer  stored  in  a computer  can  have.  Storing  in  double 
precision  will  double  the  space  required  to  store  the  states 
and  may  net  be  sufficient  for  seme  of  the  generalizations. 

On  the  other  hand,  if  the  states  are  stored  according  to  the 
vector  representation  used  to  sequence  them,  the  numbers 
stored  would  be  in  ascending  order,  and  an  efficient  search 
technique  could  be  designed  to  determine  the  state  number 
for  a state  given  its  vector  representation. 

fly  storing  separately  the  right  and  left  subvectors, 
the  space  required  to  store  the  states  can  be  reduced  and  at 
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the  sane  time  a more  efficient  method  for  determining  the 
state  number  from  the  vector  representation  can  be 
developed.  Consider  how  this  might  be  accomplished  for  the 
key  example  sequenced  according  to  a lexicographic  ordering 
of  the  ISTATEml  vector  representation. 

Each  subvector  will  be  stored  as  a single  number  as 

described  above.  In  this  way  the  840  states  of  the  example 

considered  above  would  require  127  locations  for  storage  of 

the  120  right  subvectors  and  7 left  subvectors.  The  same 

problems  arise  concerning  the  number  of  digits  a stored 

integer  can  have.  However,  since  the  left  and  right 

sutvectors  are  stored  separately,  the  variety  of  cases  which 

can  be  handled  without  utilizing  double  precision  is  vastly 

increased.  In  fact,  in  many  cases  storage  of  the  balance 

equations  and  auxilliary  storage  required  to  solve  them  will 

cause  core  problems  nefore  there  is  any  need  to  worry  about 

utilization  of  double  precision  for  state  storage.  (The  key 

example  with  N = 5,  N =3  and  M = 4 results  in  147,840 
1 2 

terms  in  27,720  balance  equations.  As  indicated  in 

subsection  2.3  of  Chapter  IV,  a case  with  35,280  terms  in 
6,930  balance  equations  required  396K  bytes  of  storage  on  an 
IBfl  360-67.  Of  this,  nearly  127K  bytes  were  required  for 
storage  of  the  balance  equations,  state  probabilities  and 
state  vectors.  The  earlier  example  would  require  over  527K 
bytes  to  store  these  same  things.)  Furthermore,  the  idea  of 
splitting  a vector  into  subvectors  and  storing  only  the 
subvectors  could  be  used  on  a subvector  too  large  to  store 
in  single  precision. 

New,  consider  storage  of  the  left  subvectors. 

Storage  will  be  in  terms  of  a single  number  for  each 
subvector.  For  example,  if  N ^ = 2 and  = 3,  {2, 1,2, 2,1} 
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is  a valid  left  subvector  and  will  be  stored  as  21221.  A 


computationally  efficient  method  of  performing  such  a 
translation  from  integer  vector  to  integer  scalar  is  given 
as  Algorithm  2 in  Appendix  3.  An  easy  dual  to  this 
algorithm  can  be  used  to  produce  an  integer  vector  from  a 
stored  scalar.  Storage  of  the  left  subvectors  is 
accomplished  by  using  Rule  3 of  the  ISTATEml  procedure  to 
successively  generate  the  subvectors.  Each  time  a new 
subvector  is  generated.  Algorithm  2 can  by  used  to  determine 
the  corresponding  number  to  be  stored.  A computational 
method  can  be  developed  to  derive  each  stored  number  from 
its  predecessor  by  addition  of  some  powers  of  10  and 
subtraction  of  others  based  upon  which  components  of  the 
left  subvector  must  be  increased  and  which  decreased  to 
derive  the  next  left  subvector. 

Storage  of  the  rignt  subvectors  may  be  accomplished 
in  exactly  the  same  manner.  However,  if  the  states  are 
ordered  according  to  the  ISTATEml  scheme,  a relatively 
simple  computational  scheme  makes  it  possible  to  store  the 
appropriate  numbers  without  having  to  use  Rules  1 and  2 to 
successively  generate  the  right  subvectors. 

The  numbers  to  ne  stored  are  all  integers  of  M 
digits  or  less  whose  digits  sum  to  N or  less.  These  numbers 
are  to  be  stored  in  groups  with  those  whose  digits  sum  to 
zero  first,  followed  by  those  whose  digits  sum  to  one,  then 
two,  and  so  forth  up  to  those  whose  digits  sum  to  N.  Within 
each  group,  the  numbers  are  to  be  stored  in  ascending  order. 
The  number  of  numbers  in  the  k-th  group  (i.e.,  the  number  of 
integers  of  H digits  or  less  whose  digits  sum  to  k)  is 

C , the  number  of  combinations  of  H - 1 + k thincs 

H- 1*  k, k 

taken  k at  a time,  which  may  be  calculated  from: 
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= n!  / [ ri  (n-r)  I ] 


C 

n,r 

The  O-th  group  contains  only  zero  and  is  not  stored. 

0 12  M-1 

The  1-th  group  consists  of  10  = 1,  10  , 10  , ...,  10 

For  k > 1 , each  number  in  the  k-th  group  is  the  sum  of  a 
number  in  the  1-th  group  and  a number  in  the  (k-1) -th  group. 
Algorithm  3 in  Appendix  B uses  these  facts  to  store  the 
right  subvector  in  an  array  (KSTG)  without  generating  and 
translating  them.  This  algorithm  also  requires  two 
auxiliary  vectors,  NSTG1  and  NSTG2,  each  of  length  N.  For 
k = 1,  2,  . ..,  N,  NSTGl(k)  is  the  component  number  of  the 
first  and  NSTG2(k)  of  the  last  number  in  KSTG  in  the  k-th 
grcup. 


Example  2.9 


Consider  the 


key  example  with  N 


2 and  61 


2 


discussed  in  Examples  2.7  ana  2.8.  Recall  that  this  system 
has  90  states  so  that  storing  each  state  as  a single  integer 
would  require  90  storage  locations.  By  using  Rule  3 of  the 
lexicographic  ordering  procedure  for  the  ISTATEml  vector 
representation,  the  left  subvectors  can  be  stored  in  a 
vector  LSIG: 

LSTG  = (1122, 1212,1221,2112,2121, 2211} 

Using  Algorithm  3 the  right  subvectors  can  also  be  stored: 

KSTG  = {1,10,2, 11,20,3, 12,21,30,4,13,22,31,40} 

The  total  storage  required  (including  four  spaces  each  for 
the  auxilliary  vectors  NSTG1  and  NSTG2 ) is  28  spaces.  Note 
that  if  nc  use  is  to  be  made  of  the  contents  of  NSTG1  and 
NSTG2  later,  KSTG  could  be  generated  first  and  NSTG1  and 
NSTG2  could  use  the  same  storage  locations  as  LSTG. 

Two  questions  remain.  First,  how  can  the  states  be 
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sequentially  generated  once  KSTG  and  LSTG  have  been  filled 
in?  Second,  how  can  the  state  number  be  determined  from 
either  the  ISTATE  or  the  ISTATEml  vector  representation  of  a 
state  ? 

First,  observe  that,  based  upon  the  three  rules  for 
ISTATFm 1 lexicographic  ordering,  the  left  subvector 
successively  takes  on  all  of  its  possible  values  between 
sucessive  changes  in  the  right  subvector.  The  answer  to  the 
first  question  is  now  guite  natural: 

Algorithm  for 

Sequential  Generation  of  states 

(i)  Set  the  right  subvector  at  its  first  feasible 
value,  namely,  all  zeros. 

(ii)  To  get  the  first  k states,  where  k is  the 
length  of  LSTG,  successively  set  the  left 
subvectcr  to  the  values  indicated  by  the 
components  of  LSTG,  leaving  the  right  subvector 
fixed. 

(iii)  Repeat  (ii)  with  the  right  subvector  set 
successively  at  the  values  indicated  in  KSTG. 

This  procedure  is  demonstrated  in  Example  2.8.  The  number 

of  components  of  KSTG  is  the  value  of  the  last  (N-th) 

component  of  NSTG2  if  Algorithm  3 is  used  to  store  the  right 

subvector.  The  number  of  components  of  LSTG  is  the  number 

of  distinguishable  permutations  of  N ones  and  N twos, 

1 2 

i.e . , 

C = N ! / (N  ! N ! ) 

N,  N ^ 12 

Io  determine  the  state  number  of  a state  from  either 
its  ISTAIE  or  its  ISTATEml  vector  representation,  use  the 
formula 


1 
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(2.  1)  state  number  = 1c  x C + m 

N,Ni 

where  the  right  subvector  of  the  vector  representation  cf 
the  state  corresponds  to  the  k-th  component  of  KSIG  (the 
zero  vector  corresponds  to  the  "O-th  component"  of  KSTG) , 
and  the  left  subvector  corresponds  to  the  m-th  component  of 
LSTG.  To  determine  the  values  of  k and  m,  convert  the  left 
and  right  subvectors  of  the  state  into  integers  and  do  a 
search  through  LSTG  and  KSTG.  While  converting  the  right 
subvector/  the  sum  of  the  components  should  be  accumulated. 
If  this  sum  is  zero,  k = 0.  If  the  sum  is  s H,  then  KSTG 
need  be  searched  only  from  component  NSTGI(s)  to  component 
NSTG2  (s)  . A search  in  LSTG  is  simplified  by  the  fact  that 
the  ues  of  the  components  increase  with  component  number. 

Algorithm  4 of  Appendix  B gives  an  alternative  to  a 
..ich  in  LSTG.  No  comparison  has  been  made  between  this 
algorithmic  procedure  and  a search  procedure.  It  seems 
likely  that  the  search  procedure  is  better  when  the  length 
of  LSTG  is  relatively  small,  and  the  algorithmic  procedure 
is  better  when  it  is  relatively  large.  It  is  not  known 
whether  the  algorithm  can  be  extended  to  cases  in  which  the 
number  of  jot  types  exceeds  two. 

3.3.  Generalization  of  Numper  of  Job  Types 

The  development  in  the  preceding  subsection  still 
applies  with  the  obvious  change  of  Rule  3 for  lexicographic 
sequencing  of  the  states  according  to  the  ISTATEml  vector 
representation : 

Rule  3:  The  last  N components  consist  of  N ones, 

1 

N twos,  ...,  N K's  where  K is  the  total  number 
2 K 
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A 


of  job  types 


The  combinatorial  term  in  (2.1)  mast  be  changed  to 

N I / (N  IN  I...N  ! ) 

1 2 K 

Example  2.10 

Suppose  K = 3,  N = 2 , N = 1,  N =1  and  M = 2.  Then 
12  3 

KSTG  is  exactly  as  reported  in  Example  2.9  and 

LSTG  = {1123,1132,1213,1231,1312, 1321,2113,2131,2311, 

3 1 12, 3121 ,321 1} 

The  combinatorial  term  to  be  used  in  (2.1)  is  C = 

41/ (2!  1!  II)  = 12  which  can  be  verified  by  counting  the 
components  of  LSTG.  Using  (2.1)  we  will  now  calculate  the 
state  number  for  the  state  having  I_  'ATE  vector 
representation  { 1 , 3,  1 , 2, 0, 3}  . Note  that  its  ISTATEml  vector 
representation  is  {3 ,0 , 3 , 1 ,3 , 1 , 2}  . Its  left  subvector 
corresponds  to  1312,  the  fifth  component  of  LSTG.  Its  right 
sutvector  corresponds  to  3,  the  sixth  component  of  KSTG. 

Tne  state  number  is  : 6x12+5=  77.  The  total  number  of 

states  is  180. 

3.4.  Generalization  of  Number  of  Servers 

first  consider  the  case  in  which  the  CPU  is  the  only 
multiserver  gueue  with  L > 2 servers.  Then,  as  pointed  out 
in  subsection  2.3,  the  order  of  the  jobs  in  service  at  the 
CPU  is  immaterial.  The  result  is  that  some  states  will  be 
represented  more  than  once  in  a lexicographic  ordering  of 
the  states  (whether  based  on  the  ISTATE  or  the  ISTATEml 
vector  representation) . One  way  to  handle  this  problem  is 
to  redefine  the  left  subvector  to  be  "those  of  the  first  N 
components  representing  jobs  not  in  service  at  the  CPU." 
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Note  that  this  leads  to  a variable-length  left  subvectcr. 
When  the  number  of  jobs  at  the  CPU  is  zero,  the  length  of 
the  left  subvector  is  N.  When  the  number  of  jons  at  the  CPU 
is  N,  the  length  of  the  left  subvector  is  N - L if  L < N or 
zero  if  the  CPU  is  an  IS  queue.  Since  the  left  subvector  is 
at  the  right  side  cf  the  ISTATEml  vector  representation,  an 
advantage  is  realized  by  seguencing  the  states  according  to 
this  representation.  Namely,  by  revising  the  sequencing 
procedure  to  ignore  a number  of  components  at  the  right  end 
of  the  vector  (where  the  number  to  be  ignored  can  be 
calculated  from  the  first  component  of  the  vector) , no 
states  will  be  duplicated.  This  can  be  accomplished  by 
changing  Buie  3 (for  the  lexicographic  ordering  procedure 
for  the  ISTATEml  vectors)  to  read: 

Rule  3:  The  last  m = min(L,N-k)  components  (where 
k is  the  value  of  the  first  component)  are  all 
zeros.  The  N - m components  immediately  preceding 
these  consist  solely  of  ones  and  twos.  There  must 

be  nc  mere  man  N ones  and  no  more  than  N twos. 

1 2 

When  storing  the  left  subvectors  (as  redefined 
abeve) , those  cf  zero  length  are  not  stored.  Those  of 
positive  length  are  stored  in  ascending  order.  Thus,  the 
shortest  subvectors  are  listed  first,  followed  by  the  next 
snertest,  and  so  forth  up  to  those  of  length  N.  Several 
auxiliary  vectors  may  be  maintained  to  aid  in  determining 
state  numbers  from  vector  representations  and  sequential 
generation  of  the  states.  For  example,  NSTG2  may  be  used  to 
held  information  concerning  the  location  in  LSTG  of  the 
beginning  and  end  of  each  group  cf  numbers.  For  k = 1,  2, 
...,  N,  component  NSTG2(k)  *■  1 would  contain  the  first  and 
NST G2  (k ♦ 1 ) the  last  of  the  k-digit  numbers  in  LSTG.  Using 
Rule  3,  the  subvectors  can  be  sequentially  generated  bj 
allowing  m to  successively  take  on  values  from  min(L,N-1) 
down  to  zero  and,  for  each  value  of  m,  generating  in 
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lexicographic  order  all  feasible  left  subvectors  of  length 
N - m.  Each  time  a new  subvector  is  generated  it  is  stored 
in  LSTG , and  each  time  the  value  of  m changes  the 
appropriate  component  of  NSTG2  would  be  given  a value. 
However/  as  pointed  out  in  Algorithm  5 of  Appendix  B,  once 
the  shortest  subvectors  have  all  been  stored  in  this  manner, 
a computational  scheme  can  be  used  to  fill  in  the  remainder 
of  LSTG  and  NSTG2.  This  algorithm  utilizes  the  fact  that 
each  (k+ 1) -digit  number  in  LSTG  is  the  same  as  some  k-digit 
number  in  LSTG  with  either  a one  or  a two  attached  to  its 
right  end. 

After  an  example  consideration  will  be  given  to  the 
two  recurring  guestions:  How  may  the  states  be  sequentially 
generated  from  the  stored  subvector?  And  how  Can  the  state 
number  be  derived  from  the  vector  representation? 


Example  2.11  (a) 

Consider  a model  similar  to  the  key  example  except 
that  tne  CPU  is  a aultiserver  with  L = 2.  Suppose  N =2, 

N ^ = 3 and  M = 2.  The  minimum  length  of  a left  subvector 

stored  in  LSTG  is  max(1,N-L)  = 3.  Tne  steps  of  Algorighm  5 
yield : 

(i)  NSTG  2 ( 1)  = 0,  NSTG2  (2)  = 0,  NSTG2(3)  = 0 

(ii)  Starting  with  the  first  component,  LSTG  = 
{112,121,122,211,212,221,222}.  Note  that  111  is 
not  stored  since  N1  = 2. 

(iii)  NSTG2  (4)  = 7 

(iv-vii)  LSTG  (8)  = 1122,  derived  from  LSTG(1) 

LSTG  (9)  = 1212,  derived  from  LSTG  (2) 

LSTG  (10)  = 1221  and  LSTG(1  1)  = 1222,  both 
derived  from  LSTG  (3) 

Starting  at  the  twelfth  component. 
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LSTG  = {2112, 212  1,2122,  2211,2212,2221} 

(iii)  NSTG2  (5)  = 17 

(iv-vii)  Starting  at  the  eighteenth  component, 

LSTG  = {11222,12122,12212,12221,21122,21212, 

21221,22112,22121,22211}  . 

(iii)  NSIG2  (6)  = 27 
An  application  of  Algorithm  3 yields: 

KSTG  = {1,  10,  2,  1 1 ,20,3,  12,21,30,4,13,22,31,40,5,  14, 
23,32,41 , 50} 

and 

NSTG1  = {1,3,6,10,15,21} 

where  the  last  component  of  NSTG1  has  been  put  in  so  that 
for  k = 1,2, 3, 4, 5,  the  numbers  in  KSTG  whose  digits  sum  to  k 
start  at  component  NSTG1 (k)  and  end  at  NSTG1(k+1)  - 1. 

Osing  the  results  of  this  example  as  a guide,  it  can 

be  seen  how  the  states  may  be  generated  seguentially  from 

the  information  stored  in  KSTG,  LSTG,  NSTG1  and  NSTG2. 

First  set  the  right  subvector  at  its  first  feasible  value, 

the  zero  vector.  The  length  of  the  left  subvector  is  k = 

max(0,N-L)  since  all  N jobs  are  at  the  CPU.  If  k = 0 (i.e., 

if  the  CPU  is  an  IS  queue) , then  there  is  one  such  state. 

(The  left  subvector  can  be  filled  in  with  N ones  and  N 

1 2 

twos  in  any  order  if  an  ISIATE  vector  representation  is 

required.)  If  k > 0,  tnen  leaving  this  right  subvector 
fixed,  generate  successive  states  by  successively  setting 
the  left  subvector  equal  to  the  values  indicated  by  the 
numbers  stored  in  LSTG  from  component  NSTG2(k)  + 1 to 
component  NSTG2(k+1).  From  this  point  on,  the  successive 
states  are  generated  by  setting  the  right  subvector 
successively  to  the  values  indicated  by  the  numbers  stored 
in  KSTG,  for  each  right  subvector,  determining  the  length, 
k,  of  the  left  subvector  and  setting  the  left  subvector 
successively  to  the  values  indicated  by  the  numbers  stored 
in  the  appropriate  section  of  LSTG.  Note  that  k need  not  be 
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recalculated  each  time  the  right  subvector  is  changed  since 
it  will  be  constant  for  all  components  of  KSTG  from 
component  NSTGI(m)  to  component  NSTG1(m+1)  - 1,  for  m = 1, 

2 , • . • , N . 


Example  2 . 1 1 (b) 

The  following  table  lists  the  value  of  the  KSTG 
component  used  to  derive  the  right  subvector  and  the  value 
of  the  LSTG  component  used  to  derive  the  left  subvector  for 
45  of  the  1 6 C states. 


NS 

KSTG 

LSTG 

NS  KSTG 

LSTG 

NS 

KSTG 

LSTG 

1 

0 

112 

16 

10 

121 

80 

4 

2221 

2 

0 

121 

21 

10 

222 

3 1 

13 

1122 

3 

0 

122 

22 

2 

112 

91 

22 

1122 

4 

0 

211 

23 

2 

222 

1 1 1 

40 

1122 

5 

0 

212 

35 

1 1 

222 

120 

40 

222  1 

6 

0 

221 

42 

20 

222 

121 

5 

11222 

7 

0 

222 

49 

3 

222 

122 

5 

12122 

3 

1 

112 

56 

12 

222 

123 

5 

12212 

9 

1 

121 

63 

21 

222 

130 

5 

2221  1 

10 

1 

122 

70 

30 

222 

140 

14 

2221  1 

1 1 

1 

211 

71 

4 

1 122 

150 

23 

2221  1 

12 

1 

212 

72 

4 

1212 

170 

4 1 

2221  1 

13 

1 

221 

73 

4 

1221 

178 

50 

22112 

14 

1 

222 

74 

4 

1222 

179 

50 

22121 

15 

10 

112 

75 

4 

2112 

180 

50 

2221  1 

New,  consi 

der  how 
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number  from 

the 

vector 

representation 

of  a 

state . 

The  right 

subvector 

can 

be  translated 

into  an 

integer  and 

located  in 

KSTG.  This 

search  can 

be  simplified 

by  use 

i of  N5TG1 . From 

the  right 

sub  vector 

can  be  determined  the 

i appropriate 

length,  k,  cf 

tne 

left  s 

ub vector 

. The 

first 

k components 

of  the  ISTATE 

vector  representation  is 

the  left  subvector. 

This  can  be 

translated 

into  an 

integer  value  and 

located 

in 

LSTG.  Use 

of 

NSTG2  will  simplify  th 

is  search. 

0 nf ortunate 

ly,  a simple 

formula  such  as  (2.1)  cannot  be  applied  at  this  point.  In 
contrast  to  the  key  example,  the  number  of  states  associated 
with  each  component  of  KSTG  prior  to  the  component  under 
consideration  may  not  be  constant.  However,  this  difficulty 
can  be  overcome  since  this  number  is  constant  within  the 
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groups  of  KSTG.  That  is,  the  sum  of  the  digits  of  a 
component  of  KSTG , say  s,  determines  the  length,  k,  of  the 
left  subvector  which,  in  turn,  determines  the  number  of 
states  associated  with  that  component  of  KSTG.  Thus,  the 
same  number  of  states  is  associated  with  each  component  of 
KSIG  having  the  same  value  for  s.  An  auxiliary  vector, 
NSTG4,  of  length  M can  be  used  to  store  the  total  number  of 
states  associated  with  all  components  of  KSTG  prior  to  each 
grcup  of  ccmpcnents  of  KSTG.  The  information  in  NSTG1  and 
NSIG2  is  all  that  is  necessary  to  determine  the  values  of 
the  components  of  NSTG4 . Aigoritnm  6 of  Appendix  B 
accomplishes  this  task. 

Ihe  state  number  can  now  be  determined  from  the 
vector  representation.  Suppose  that  the  sum  of  the 
components  of  the  right  subvector  is  s and  the  right 
sucvectcr  corresponds  to  KSTG  ( j)  , where  j = 0 if  s = 0 . (If 
s * G,  the  search  for  j should  take  place  between  components 
NSIGI(s)  and  NSTGl(s+1)  - 1 of  KSTG.)  From  s we  determine 
that  the  length  or  the  left  subvector  is  k = max(s,N-L). 
Suppose  that  the  left  subvector  corresponds  to  LSTG (i) , 
where  i = 0 if  k = 0.  (If  k * 0,  the  search  for  i should 
take  place  between  components  NSTG2  (k)  + 1 and  NSTG2(k  + 1)  of 

LSI G . ) The  state  number  is  given  by: 

state  number  =[j-  NSTG1  (s)  ]x[  NSTG2  (k+1)  - NSTG2  (k)  ] 

♦ [i  - NSTG2  (k)  ] ♦ NSTG4  (s) 

where  NSTG1  (0)  = 0,  'JSTG2  (0)  = 0 and  MSTG4  (0)  = 1 if  k = 0 
and  N STG 4 ( 0)  = 0 otherwise. 

Example  2.  1 1 (c) 

Using  Algorithm  6,  NSTG4  = (7, 21 , 42 , 70, 120} . (Note 
that  all  of  these  states  are  in  the  taole  in  part  (b)  of 


no 


this  example.)  Consider  calculation  of  the  state  number  for 
1ST  AT  E = {1,1,  1,2, 2,3,  1}  . Note  that  s = 3 ♦ 1 = 4,  NS1G1(4) 
= 10,  k = ma  x (4, 5-  2)  = 4,  NSTG2(5)  = 17  and  NSTG2(4)  = 7. 

The  right  sutvector  corresponds  to  31  = KSTG(13) , so  j = 13. 
Since  k = 4,  the  left  subvector  is  1212  = LSTG(9),  so  i = 9. 
Finally,  NSTG4  (4)  = 70.  So  the  state  number  is 
[13  - 1 0 ]x[  1 7 - 7 ] + [ 9 - 7 ] ♦ 70  = 102 

New  suppose  that  the  multiserver  gueue  is  one  of  the 
PE"  s rather  than  the  CPU.  Then  all  of  the  above  can  be  used 
if  the  left  subvector  is  redefined  to  consist  of  "those  of 
the  first  N components  of  the  ISTATE  vector  representation 
representing  jobs  not  in  service  at  PPj,"  where  P?j  is  the 
multiserver  gueue. 

A more  difficult  case  is  one  in  which  two  or  mere 

processors  are  multiserver  gueues.  For  example,  consider  a 

case  in  which  PP1  has  L servers  and  the  CPU  has  L servers 

1 C 

(both  larger  than  one)  . Conforming  to  the  above  procedure, 

define  the  left  sutvector  to  consist  of  "these  of  the  first 
N components  of  the  ISTATE  vector  representation 
representing  jobs  not  in  service  at  either  PP1  or  the  CPU." 

A new  problem  arises  in  this  case.  This  problem  is 
illustrated  in  the  following  example. 


Example  2.12 

Consider  a case  in  which  N =4,  N =4,  fl  = 3 and  PP1 

1 2 

and  the  CPU  are  IS  gueues.  Then  associated  with  a left 
subvector  = {1, 1,2,2}  and  a right  subvector  = {2,3,1}  are 
three  states.  Note  that  two  I's  and  two  2's  are  distributed 
between  PF1  and  the  CPU,  two  joDS  going  to  each  processor. 
The  three  states  arise  by  assigning  both  type  one  jobs,  or 
botn  type  two  jobs,  or  one  job  of  each  type,  to  the  CPU. 
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Ihis  problem  may  be  handled  by  the  addition  of  a 
single  component  on  the  right  end  of  the  left  subvector 
specifying,  for  example,  the  number  of  type  one  jobs  in 
service  at  PP1.  However,  since  the  maximum  value  of  this 
added  component  depends  upon  the  value  of  the  first 
component  of  the  right  subvector,  some  of  the  resulting 
values  in  the  appropriate  section  of  LSTG  may  need  to  be 
bypassed  for  some  right  subvectors.  This  fact,  along  with 
the  multiplicative  effect  that  addition  of  such  a component 
has  on  the  length  of  LSTG  and  the  fact  that  further 
components  must  be  added  as  the  number  of  multiserver  queues 
increases,  makes  separate  maintenance  of  this  information  a 
more  attractive  option.  Such  separate  maintenance  might 
involve  creation  of  another  storage  vector,  say  MSTG,  and  an 
associated  pointer  vector,  say  MSTG5 . The  details  of  this 
procedure  will  not  be  discussed  here. 

Note  that  this  problem  disappears  if  only  one  type 
of  job  can  route  to  each  multiserver  PP.  This  is  the 
subject  cf  the  next  subsection. 

3.5.  A Specialization : Zero  Branching  Probabilities 

Consider  a special  case  of  tne  key  example  in  which 
ALFA  (1,1)  = C;  i.e.,  only  type-two  jobs  are  allowed  to  route 
to  PP  1 . As  a result,  the  order  of  job  types  at  PP1  is  not 
needed  in  specification  of  a state.  In  ether  words,  no 
informaticn  concerning  PP1  need  be  retained  in  the  left 
subvector.  The  left  subvector  may  be  defined  to  consist  of 
"those  of  the  first  N components  n.of  representing  jobs  at 
PP 1 . " In  such  cases,  variable  length  left  subvectors  as 
discussed  in  subsection  3.4  are  quite  useful.  In  fact,  if 
only  one  type  of  job  has  zero  branching  probabilities,  some 
of  the  procedures  discussed  above  may  be  simplified.  As  an 
alternative,  the  normal  procedures  for  the  key  example  as 


discussed  in  subsection  3.1  and  3.2  could  be  followed 
ignoring  the  fact  that  many  of  the  represented  states  are 
invalid.  The  final  steady-state  probability  distribution 
will  assign  zero  probability  to  each  of  the  invalid  states. 

As  a complication,  suppose  (in  addition  to  ALFA  (1,1) 
= 0)  that  the  CPU  is  a multiserver  queue.  Then  a subtle 
problem  arises.  Consider  the  following  example. 


Example  2.13 

Suppose  ALFA  (1,1)  = 0 and  the  CPU  is  an  IS  queue. 

Consider  using  the  ISTATEml  techniques  discussed  earlier  in 

this  section.  Defining  the  left  subvector  to  consist  of 

these  of  the  first  N components  of  the  ISTATE  vector 

representation  not  representing  jobs  at  ?P1  or  jobs  at  the 

CPC,  the  length  of  the  left  subvector  is  the  sum  of  the 

components  of  the  right  subvector  less  the  first  component. 

Suppose  N s 4,  N =3  and  M = 3.  Then  the  portion  of  LSTG 
1 2 

containing  four-digit  numbers  is: 

(1  111,  1 112,  1 121,  1 122,  12  11,  1 212,  1221, 1222,21  1 1 ,21  12, 

212 1,2  122, 221 1,221  2, 2221} 

Each  of  these  components  can  be  used  to  generate  state 
vectors  if  the  right  subvector  is  {0,3,1}.  However, 
consider  the  right  subvector  {3,3,1}.  The  length  of  the 
appropriate  left  subvectors  is  again  four.  But,  the  fact 
that  three  of  the  four  type-two  jobs  must  be  located  at  PP1 
forces  frem  consideration  any  left  subvector  containing  more 
than  one  2.  Thus,  the  components  of  LSTG  usable  in  this 
case  are: 

{1111,1112,1121,  1211,2111} 

Note  that  it  is  necessary  to  skip  around  in  LSTG. 


Ic  take  care  of  this  problem,  another  vector 


1 


representation,  hereafter  called  the  ISTATEm2  vector 
representation,  has  been  developed.  Although  its 
application  is  more  important  for  cases  such  as  that 
discussed  in  Example  2.13,  the  ISTATEm2  vector 
representation  is  introduced  here  in  terms  of  the  key 
example  sc  that  comparison  with  the  I5TATE  and  ISTATEml 
vector  repr esentations  may  be  clearly  seen. 

Ihe  ISlATEm2  vector  representation  of  the  states  of 
the  key  example  is  a vector  of  length  N + M ♦ 2 whose  first 
component  is  the  sum  of  the  components  of  the  right 
subvector,  whose  next  M components  form  the  right  subvector, 
whose  next  component  is  the  total  number  of  type-two  jobs  at 
the  PP's,  and  whose  last  N components  form  the  left 
sutvector.  The  constraints  used  in  the  lexicographic 
ordering  procedure  for  these  vectors  are: 

ISIAT£m2  Sequencing  Constraints 
Sule  1:  The  first  component  is  a nonnegative 
integer,  k,  no  larger  than  N. 

Hule  2:  The  next  d components  are  nonnegative 
integers  whose  sum  is  the  first  component. 

Buie  3:  The  next  component  is  a nonnegative 
integer  which  can  oe  no  smaller  than  k - N ^ and  no 

larger  than  the  smaller  of  k and  N . 

2 

Hule  4:  The  last  N components  consist  of  N ones 

and  N twos.  Ihe  first  k of  these  contain  exactly 
2 

the  cumber  of  twos  specified  by  the  (M  + 2)-nd 
component  (see  Hule  3)  . 
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Example  2.14 


Again  consider  the  key  example  with  N ^ = 2,  H ^ = 2 and 

M = 2.  (See  Examples  2.7  and  2.8.)  The  following  table 
shews  13  cf  the  90  states  with  their  state  numbers  as 
provided  by  a lexicographic  ordering  of  their  ISTAT  Em2 
vector  representations.  For  reference  purposes  all  three 
vector  representations  discussed  thus  far  are  listed  for 
each  state. 


NS  ISTATEm2  ISTATE  ISTATEml 


1 

0,0, 0,0, 1,1,2, 2 

l 

1,  1,2, 2,  0,0] 

[0,0,0, 1,  1,2,2} 

35 

2,2,0, 1,2, 1,2,1 

2,  1,  2,  1,2,0 

2, 2, 0,2,  1,2,1' 

36 

2 , 2 ,0 , 2,2 , 2 , 1,1 

2,2, 1,1,2, O' 

2 2,0,2  2 1 1' 

37 

3, 0,3, 1,1 ,1,2,2 

1,1, 2, 2, 0,3 

3,0,3, 1,  1,2,2' 

38 

3, 0,3,1,  1,2,  1,2 

1,2, 1,2,0, 3 

3, 0,3,1, 2*1*2' 

39 

3, 0,3, 1,2, 1,1, 2 

2,  1,1, 2, 0,3 

3,0, 3,2,  1,1,2' 

40 

3, 0,3, 2, 1,2, 2,1 

1,2,2,  1,0,3' 

3, 0,3, 1,2, 2,V 

41 

3,0 ,3 ,2 , 2 , 1 , 2 , V 

2,1,2,1,0,31 

3,0, 3,2,  1,2,1 

42 

3, 0,3, 2, 2, 2,  1,1 

2,2,  1,1,0,  3; 

3, 0,3, 2, 2, 1,1 

43 

3, 1,2, 1,1, 1,2, 2 

1,1,2, 2,  1,2 

■ 

3, 1,2,1,  1,2,2 

45 

2, 1,2, 1,2, 1,1,2 

2,1,  1,2, 1,2 

3, 1,2, 2, 1,1, 2 

46 

3, 1,2, 2, 1,2, 2,1 

1,2,2,  1,1,2 

3, 1,2, 1,2, 2,1 

90 

4,4,0, 2,2,2,  1,1 

2,2,1,  1,4,0 

4 *4,0, 2, 2^  1*1' 

In  this  example  tnere  is  little  difference  between 
the  order  of  the  states  when  the  sequencing  procedure  is 
based  on  the  ISTATEml  vector  representation  and  when  it  is 
based  on  the  ISTATEm2  vector  representation.  An  occasional 
pair  of  states  (such  as  states  39  and  40)  are  reversed  in 
order.  In  the  following  example  the  difference  is  more 
pronounced . 


Example  2.15 

Consider  the  key  example  in  which  N = 4,  N =3  and  M 

1 2 

= 2.  The  following  table  shows  24  of  the  1260  states  with 
their  state  numbers  as  provided  by  a lexicographic  ordering 
of  their  ISTATEm2  vector  representations.  Note,  for 
example,  that  for  state  number  561,  the  first  component  of 
the  ISTATEm2  vector  representation  indicates  that  there  are 
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five  jobs  at  the  PP's.  The  next  two  components  indicate 
that  one  cf  these  is  at  PP1  and  the  remaining  four  are  at 
PP2.  The  fourth  component  indicates  that  only  one  of  the 
five  is  a type-two  job.  The  remainder  of  the  vector 
indicates  that  the  job  at  ?P1  is  a type-one  job,  the 


type-two  job  is  the  one  in  service  at  PP2 , and  two  type-two 


jots  are  at  the  CPU, 

NS 

525 

526 

527 

528 

52  S 

530 

531 

53  2 
533 
53  4 

535 

536 

537 

538 

53  S 

54  1 
543 

549 

550 

551 

552 

553 
560 
56  1 


IST&T  Em2 


{4,4 

,0, 

3, 

2,2 

,2, 

1, 

1 

,1 

, 1] 

[5,0 

#5, 

1, 

1,1 

, 1, 

1, 

2 

,2 

, 2' 

'5,0 

,5, 

1, 

1,  1 

, 1, 

2, 

1 

,2 

,2' 

'5,0 

, 5 , 

1,1 

,2, 

1, 

1 

,2 

, 2' 

'5,0 

,5, 

1, 

1,2 

, l' 

1, 

1 

,2 

,2' 

'5,0 

, 5, 

1, 

2,  1 

, 1, 

1, 

1 

,2 

, 2' 

5,0 

,5, 

2. 

1,1 

, 1, 

2, 

2 

,1 

,2' 

5,0 

/ 3 / 

2, 

1,1 

' 1, 

2, 

2 

,2 

, 1 

'5,0 

.5. 

2l 

1,  1 

,2, 

1, 

2 

,1 

,2' 

'5,0 

, 5 , 

2, 

1,  1 

, 2, 

1, 

2 

,2 

, 1 

'5,0 

, 5, 

2. 

1,1 

,2, 

2, 

1 

1 

,2' 

5,0 

,5, 

2, 

1,  1 

,2, 

2, 

1 

,2 

, 1 

5,0 

,5; 

2, 

1,2 

,1, 

1, 

2 

,1 

,2' 

'5,0 

w. 

2, 

1,2 

,1, 

1, 

2 

2 

, 1 

5,  0 

, 5 , 

2, 

1,2 

l' 

2, 

1 

II 

,2' 

'5,0 

, 5 , 

2, 

1,2 

,2, 

1, 

1 

, 1 

, 2' 

'5,0 

,5, 

2, 

2,  1 

, ll 

1, 

2 

^1 

,2' 

5,0 

.5, 

2, 

2,2 

, 1, 

1, 

1 

, 1 

,2' 

5 0 

,5, 

2, 

2,2 

, 1, 

1, 

1 

g ^ 

, r 

'5,0 

3, 

1,  1 

.2, 

2, 

2 

I 1 

, 1 

'5,0 

f S g 

3, 

1,2 

, 1, 

2, 

2 

,1 

, 1 

'5,0 

, 5 , 

3, 

1,2 

,2, 

1, 

2 

, 1 

, 1 

'5,0 

, 5, 

3, 

2,2 

,2, 

1, 

1 

1 

, 1 

5,  1 

#4, 

1, 

1,1 

, 1, 

1, 

2 

,2 

, 2' 

Despite  tne  introduction  above,  the  ISTAT2m2  vector 
representation  is  not  particularly  useful  for  the  key 
example.  It  is  more  useful  in  cases  in  which  the  left 
sutvector  has  variable  length. 


Consider  the  case  in  which  ALFA  (1,1)  = 0 and  the  CPU 
is  a multiserver  gueue  with  L > 2 servers.  The  left 
sufcvector  contains  tne  job  types  at  PP 2 , ...  , PPM  and 
engueued  at  the  CPU.  The  first  M ♦ 1 components  of  the 
ISTAT2m2  vector  representation  of  states  of  the  system  are 
defined  as  above.  Redefine  the  next  component  to  be  the 
total  number  cf  type-two  jobs  at  PP2 , ...,  PPM  and  engueued 
at  the  CPU,  or  eguivalently , the  total  number  of  twos  in  the 
left  subvectcr.  This  is  followed  by  the  left  subvector  and 
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whatever  zeros  are  required  to  complete  the  N + M + 2 
components.  Rules  3 and  4 must  be  changed  to  conform  to 
this  redefinition.  The  fact  that  only  type-two  jobs  can 
route  to  PP 1 forces  a change  in  Rule  2 also.  The  complete 
set  of  rules  is: 


ISTATEm2  Sequencing  Constraints 
Rule  1:  The  first  component,  k,  is  a nonnegative 
integer  no  larger  than  N. 

Rule  2:  The  next  M components  are  nonnegative 
integers,  the  first  of  which  is  no  larger  than  . 

The  sum  of  these  components  must  be  k. 

Rule  3:  The  next  component  is  a nonnegative 
integer  which  can  be  no  smaller  than  the  larger  of 

k - n - N and  N - n - L,  and  which  can  be  no 

11  2 1 

larger  than  the  smaller  of  N - n and  m,  where  n 

2 1 1 

is  the  second  component  (i.e.,  the  number  of  jobs 
at  PP 1)  and  m = k - n^  ♦ max(0,N-k-L)  is  the 

length  cf  the  left  subvector. 

Rule  4:  The  next  m components  consist  solely  of 
ones  and  twos.  The  number  of  twos  among  the  m 
components  is  the  value  of  the  (M  + 2) -nd 
component  (see  Rule  3) . The  last  N - m components 
are  all  zeros. 

As  can  be  deduced  from  our  willingness  to  change  the 
description  cf  a vector  representation  to  meet  specific 
situations  without  changing  the  name  of  the  representation, 
the  name  cf  a vector  representation  does  not  denote  a 
specific  set  of  rules.  Rather,  it  denotes  a type  of 
ordering  cf  the  states.  For  the  1ST ATE  veetc  : 
representation,  the  right  subvector  is  varied  for  each  value 
of  the  left  subvector.  For  the  ISTATEml  and  ISTATEm2  vector 
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representations,  the  left  subvector  is  varied  for  each  value 
of  the  right  subvector.  For  the  ISTATEml  vector 
representation,  the  appropriate  left  subvectors  are  arranged 
in  lexicographic  order  for  each  right  subvector.  As  seen  in 
Example  2.13,  this  arrangement  is  not  convenient  for  seme 
applications.  The  following  example  shows  the  ISTATEml 
arrangement  of  left  subvectors  for  each  right  subvector  in  a 
specific  group  for  the  case  discussed  in  Example  2.15. 


Example  2. 16 

Consider  again  the  case  in  which  ALFA  (1,1)  = 0,  the 

CEO  is  an  IS  queue,  N = 4,  N =3  and  M = 3.  For  the  case 

1 2 

of  lexicographic  sequencing  according  to  the  ISTATEm2  vector 

representation,  the  four-digit  components  of  LSTG  are: 

{11 11, 1 112, 1121, 121 1,2111, 1 122,1212,1221,2112,2121, 
2211,1222,2122,2212,2221} 

Note  that  for  the  right  subvector  {0,3,1}  each  of  these 
components  of  LSTG  will  provide  us  with  a valid  state.  For 
the  right  sutvector  {2,3,1},  only  the  first  five  components 
of  LSTG  will  yield  valid  states.  The  advantage  of  the 
1ST  AT  Em2  vector  representation  is  that  these  five  components 
are  in  consecutive  storage  ’locations.  Compare  this  with  the 
rasult  of  Example  2.13.  With  right  subvector  {1,3,1}  we 
associate  the  first  eleven  components  of  LSIG  and  with 
{3,3,1},  only  the  first  one. 

From  Example  2.16  it  is  apparent  that  procedures 
are  needed  for  storing  the  numbers  of  LSTG  in  the 
appropriate  order  and  for  efficient  determination  of  which 
components  of  LSTG  to  use  with  each  right  subvector.  For 
storage  of  the  numbers  in  LSTG  according  to  a lexicographic 
ordering  of  the  ISTATEml  vectors,  a modification  of  the 
algorithm  given  for  the  ISTATEml  case  is  possible. 
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Algorithn  7 cf  Appendix  B provides  an  alternative  to  such  a 
modification.  First,  note  that  because  of  the  way  LSTG  is 
used,  it  does  not  matter  whether  all  of  the  one-digit 
numbers  are  followed  by  the  two-digit  numbers,  and  so  forth 
up  to  the  N-digit  numbers,  or  the  reverse,  or  any  other 
arrangement.  It  is  simply  necessary  to  be  able  to  quickly 
determine  the  beginning  and  end  of  each  group.  In  view  of 
Example  2.16  it  is  apparent  that  determination  of  where  the 
number  of  ones  (or  twos)  changes,  even  if  the  number  of 
digits  does  net,  is  also  required.  In  Algorithm  7 the 
components  of  LSTG  are  arranged  so  that  the  numbers  with  the 
largest  number  of  digits  are  first  and  the  smallest  last. 
NSTG3  is  used  to  store  pointers  to  the  locations  in  LS1G 
where  either  the  number  of  digits  or  the  number  of  ones 
changes.  NSTG2  is  used  to  store  pointers  to  the  locations 
in  NSTG3  where  pointers  to  a change  of  digits  are  stored. 
Recall  that  the  case  under  consideration  is  the  key  example 
except  that  ALFA  (1,1)  = 0 and  the  CPU  is  a multiserver  queue 
with  L servers.  In  particular,  all  processors  except  EP1 
are  assumed  to  accept  both  types  of  jobs. 


Example  2.17(a) 

For  N = 2,  N =2  and  L > 2,  Algorithm  7 yields: 

1 2 

LSTG  = (1122,1212,1221,2112,2121,2211,112,121,211, 

122,212,221,1  1 , 12,21,22,  1,2} 

NSTG3  = {1,7,10,13,14,16,17,10,19} 

N5TG2  = {7,4,2, 1} 

Note  that  for  j = 1,2,.. .,3,  all  numbers  in  LSTG  from 
component  NSTG3  ( j)  through  NSTG3(j  + 1)  - 1 have  the  same 
numbers  of  digits  and  the  same  number  of  ones.  Furthermore, 
for  i = 1,2, 2, 4,  LSTG  (NSTG3  (NSTG2  (i)  ) ) is  the  first  i-digit 
number  stcred  in  LSTG. 

Cnee  LSTG,  NSTG2  and  NSTG3  have  been  developed  using 
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Algorithm  7 , the  components  of  a right  subvector  contain  the 
information  reguired  to  determine  which  components  of  ISTG 
contain  valid  left  subvectors  for  that  right  subvector.  For 
example,  if  n^  is  the  first  component  of  the  right  subvector 

(i.e.,  the  number  of  jobs  at  PP1)  and  k is  the  sum  of  its 
components,  then  m = k - n^  + max  (0, N- k-L)  is  the  length  of 

each  valid  left  suhvector,  j = min(m,N^)  is  the  largest 

feasible  number  of  ones,  and  i = max(0,m-N  +n  ) is  the 

2 1 

smallest  feasible  number  of  ones.  Note  that,  once  m has 
been  determined,  j is  independent  of  n^.  Thus,  the  valid 
left  subvectcrs  begin  in  component  NSTG3 (NSTG2  (m) ) of  LSTG 
and  run  through  component  NSTG3  (NSTG2  (m)  + j - i)  - 1. 

Sc  far  the  fact  that  Rule  2 restricts  the  value  of 
the  first  component  of  a right  subvector  to  be  no  larger 
than  has  been  neglected.  As  a result  Algorithm  3 for 

computational  generation  of  KSTG  and  NSTG  1 must  be  revised. 

Eriefly,  if  the  sum  of  the  components  of  the  right  subvector 
is  N^  + d,  then  the  number  of  components  in  KSTG 

corresponding  to  this  sum  of  components  must  be  reduced  by 

C . This  correction  can  be  made  easily  in  Algorithm 

M + d-2, d-  1 

3. 


Example  2.17  (t) 


If  a 


3,  the  modified  algorithm  for  right  subvectors 


KSTG 


= {1,10, 100,2,11,20,101,110,200,3,12,21,30, 
102,111,120,201,210,4,13,22,31,40,103,112, 
121,130,202,211,220} 

and 

NSTG1  = {1,4, 10, 19,31} 

At  least  two  options  are  available  for  calculation 
of  state  numbers  from  vector  representations.  A vector 
NS1G4  which  has  the  same  length  as  KSTG  could  be  used  to 
store,  for  example,  in  NSTG4  (i) , the  number  of  states  prior 
to  the  first  state  using  the  corresponding  right  subvector, 
KSTG  (i)  . Given  a state  vector  in  this  case,  the  length,  m, 
of  the  left  subvector,  the  value  of  i such  that  the  right 
subvector  is  stored  in  KSTG  (i)  and  the  value  of  j such  that 
the  left  subvector  is  stored  in  LSTG(j)  would  be  determined. 
The  state  number  is  then 

state  number  = NSTG4 (i)  + j + 1 - NSTG3 (NSTG2 (m) ) 

As  an  alternative  NSTG4  could  be  shortened  by  using 
the  fact  that  the  number  of  states  associated  with  each 
right  subvectcr  changes  when  either  the  sum  of  the 
components  cf  the  right  subvector  or  the  value  of  its  first 
component  changes.  A vector,  say  NSTG5,  could  then  be  used 
to  point  to  the  components  of  KSTG  where  either  the  first 
component  or  the  sum  of  the  components  of  the  stored  right 
subvectors  changes.  NSTG1  would  be  modified  to  point  to 
NSTG5  the  same  way  that  NSTG2  points  to  NSIG3.  NSTG4 (i) 
would  contain  the  number  of  states  prior  to  the  first  state 
using  the  right  subvector  stored  in  KSTG (NSTG5 (i) ) . Thus, 
the  length  of  NSTG 4 would  be  the  same  as  that  of  the  new 
vector  NSTG5,  making  this  procedure  less  efficient  (in  terms 
of  storage  requirements)  unless  the  length  of  NSTG 4 was  cut 
at  least  in  naif.  In  addition,  the  work  required  to 
calculate  the  state  number  would  be  increased.  The  equation 
to  be  used  is: 
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state  number  = NSTG4  (i)  ♦ [n  + 1 - NSTG3  (NSTG2  (m)  ) ] 

+ [j  - NSTG5  (i)  ]x[  NSTG3  (k+1)  - NSTG3  (NSTG2  (m) ) ] 


j 

where  j is  the  integer  such  that  the  right  subvector  is 
stored  in  KS1G  ( j) , i is  the  largest  integer  such  that 
NS1G5  (i)  < j,  n is  the  integer  such  that  the  left  subvector 


is  stored  in  LSTG(n),  m is  the  length  of  the  left  subvector, 
and  k is  the  largest  integer  such  that  LSTG ( NSTG3 ( k) ) is  a 
legal  left  subvectcr  for  use  with  the  given  right  subvector. 


3.6.  Generalization  of  Queuing  Discipline 


LCFS,  LCFSPH,  LCFSPRpt:  The  state  vectors  are  the 
same  as  in  the  FCFS  case.  Only  the  interpretation  differs. 
Thus,  unless  the  service  distributions  are  ncnexponential, 
or  blocking  or  bulking  is  possible,  storage  and  seguencing 
of  states  and  determination  of  state  number  from  vector 
representation  is  as  discussed  in  the  preceding  subsections. 

Preemptive  Priority:  The  order  of  joo  types  at  any 
processor  having  this  queuing  discipline  need  not  be 
considered  a part  of  the  left  subvector.  What  is  needed  is 
the  number  of  each  type  of  job  at  each  of  these  processors. 
Hence,  cases  such  as  these  can  be  handled  the  same  way  IS 
queues  are  handled. 

Ncnpreemptive  Priority:  In  addition  to  the 
information  required  for  preemptive  priority  queues,  the 
type  cf  job  in  service  is  required.  This  may  be  handled  by 
treating  nonp reemptive  priority  gueues  the  same  way 
preemptive  priority  queues  are  handled  but  including  the  job 
type  of  the  job  in  service  in  the  left  subvector.  A 
complication  arises  in  this  case  which  does  not  arise  in  the 
preemptive  priority  case  if  the  queue  is  a multiserver  queue 
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as  well.  The  types  of  jobs  in  service  cannot  be  added  to 
the  left  subvector  since  their  order  is  immaterial. 

Instead,  the  number  of  type  one  jobs,  for  example,  in 
service  at  each  such  queue  should  be  appended  to  the 
subvector  which  contains  information  about  the  number  of 
each  type  of  job  at  each  priority  queue. 

FS:  In  effect  a PS  queue  is  an  IS  queue  with 

state-dependent  service  rates.  PS  queues  may  be  handled  in 
exactly  the  same  way  that  IS  queues  are  handled. 

3.7.  Generalization  of  Service  Distributions 

Unfortunately,  the  relatively  compact  storage 
schemes  and  elegant  procedures  for  sequential  generation  of 
the  states  and  for  determination  of  state  numbers  from 
vector  representations  presented  earlier  in  this  section 
extend  to  only  a few  specific  cases  when  nonexponential 
service  distributions  are  introduced.  In  this  subsection  a 
procedure  for  handling  many  general  situations  will  be 
suggested . 


Consider  a model  in  which  there  are  generalized 
Erlangian  service  distributions  such  as  those  discussed  in 
subsection  4.1  of  Chapter  I.  Then,  an  array  NUM  must  be 
maintained  as  a part  of  tne  model  description.  NUM(i,j) 
should  be  the  number  of  stages  associated  with  the  service 
distribution  of  type-i  jobs  at  processor  j.  In  order  to 
completely  describe  a state  of  the  system,  a number,  say  K, 
cf  components  must  be  appended  to  any  vector  representation 
to  contain  information  concerning  stages  of  service. 
(Depending  upon  the  situation,  K may  vary  from  one  to  2 x 
N.)  Hereafter  this  collection  of  K components  will  be 
referred  to  as  the  far  subvector.  In  all  three  vector 
representations  discussed  above,  the  far  subvector  can  be 
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attached  to  the  right  end  and  rules  to  govern  the  selection 
of  values  fcr  its  components  can  be  added. 


Exa  mple  2.18 

Consider  the  case  in  which  each  processor  is  a FCFS, 
single  server  gueue  with  generalized  Erlangian  service 
distributions.  Then  the  far  subvector  is  of  length  (J  ♦ 1. 
The  j-th  component  of  the  far  subvector  contains  the  stage 
of  service  fcr  the  job  in  service  at  processor  j.  The 
convention  will  be  to  assign  the  value  of  one  to  each 
component  which  corresponds  to  an  idle  processor.  For  a 
lexicographic  ordering  of  the  ISTAIE  vectors  for  this 
system,  the  following  rules  should  be  added  to  the  two  rules 
in  subvector  3.1: 

Rule  3:  The  next  M components  are  positive 
integers  such  that  the  j-th  of  these  is  no  larger 
than  one  if  I STATE  (N  + j)  = 0,  and  otherwise  is  no 
larger  than  NUM{i,j),  where  i is  the  value  of 
component  [ ISTATE  (N  + 1 ) + ISTATE  (N+2)  ♦ ...  + 

ISTAIE  (N  + j)  ] of  ISTATE. 

Rule  4:  The  last  component  is  a positive  integer 
which  is  nc  larger  than  one  if  the  sum  cf  the 
components  of  the  right  subvector  is  N , and 
otherwise  is  no  larger  than  NUH (i ,M+ 1)  , where  i = 

ISTATE  (N)  . 

Since  the  far  subvector  is  at  the  right  end  of  any 
vector  representation  of  the  states,  a choice  of  left  and 
right  subvectors  leads  to  a group  of  states.  Thus,  to 
seguentially  generate  all  of  tne  states,  it  is  necessary 
only  to  seguentially  generate  the  left  and  right  subvectors 
a. s described  in  the  preceding  subsections  and,  each  tiie 
either  the  left  or  the  right  subvector  changes,  generate  ail 
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applicable  far  subvectors.  The  right  and  left  subvectcrs 
(and  associated  pointers)  can  be  stored  as  described  in  the 
preceding  subsections  according  to  the  seguencing  procedure 
used.  The  mcdus  operand!  will  be  to  not  store  the  far 
subwector.  Each  time  the  states  are  (sequentially) 
considered,  generation  of  the  associated  far  subvectors  may 
be  accomplished  by  performing  the  lexicographic  sequencing 
procedure  (see  subsection  3.1)  using  constraints  similar  to 
Rules  3 and  4 in  Example  2.18. 

The  remaining  question  is  how  to  determine  state 
numbers  frcm  vector  representations.  (ISTATEml  or  1ST ATEm2 
seguencing  will  be  assumed.)  To  aid  in  this  effort  create  a 
vector,  NSIG4,  having  the  same  length  as  KSTG.  NSTG4(i) 
will  be  the  number  of  states  preceding  the  first  state 
having  KSIG  (i)  as  its  right  subvector.  Now  suppose  a right 
subvector  and  a left  subvector  which  is  valid  for  the  right 
subvector  are  given.  Create  a vector,  MAX,  cf  length  K (the 
same  length  as  the  far  subvector)  sucn  that  MAX  (k)  is  the 
largest  value  the  k-th  component  of  the  far  subvector  can 
take  on  subject  to  the  constraints  imposed  by  the  given 
right  and  left  subvectors.  In  many  models  the  components  of 
the  far  subvector  can  take  on  values  independently  of  each 
other.  That  is,  the  values  that  any  given  component  can 
take  on  are  net  restricted  in  any  way  by  the  values  the 
other  components  have.  For  these  models,  each  vector  from 
tne  vector  cf  all  cnes  through  MAX  is  a feasible  value  for 
the  far  subvector.  (If  A and  3 are  vectors  of  the  same 
length,  A < E means  that  each  component  of  A is  less  than  or 
equal  tc  the  corresponding  component  of  3.  This  last 
sentence  means:  vector  of  ail  ones  < A < MAX  implies  that  A 
is  a valid  fax  subvactcr  for  the  given  right  and  left 
subvectors.  Ey  construction  of  MAX  and  convention  for  far 
subvectors,  the  reverse  implication  is  also  true.)  Thus, 
the  number  of  states  having  tne  given  right  and  left 
subvectors  is  the  product  of  the  components  of  MAX. 
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Given  a particular  far  subvector,  MAX  may  be  used 
also  to  indicate  its  relative  position  among  all  far 
sutvectors  which  are  valid  for  the  given  right  and  left 
subvectors.  Algorithm  3 of  Appendix  3 specifies  how  this  may 
be  done.  Algorithm  9 in  the  same  appendix  may  be  used  to 
determine  the  state  number  of  a state  from  its  vector 
representation  for  models  like  those  discussed  in  the 

1 1 

preceding  paragraph. 

tor  cases  in  which  the  components  of  the  far 
sutvector  are  not  independent  of  each  ether,  decompose  the 
far  sucvector  into  subvectors  such  that  the  components  are 
independent  of  each  other  within  each  subvector  but 
components  of  all  subvectors  but  the  first  depend  upon  the 
values  in  the  preceding  sub vector  (s)  . Then  attempt  to 
iterate  the  above  process.  This,  of  course,  is  a very 
complicated  procedure  at  best. 

3.3.  f irite  Capacities  and  Blocking 

The  model  considered  in  this  subsection  is  the  key 
example  except  that  the  capacity  of  the  CPU  is  C jobs,  where 
C is  a positive  integer  smaller  than  the  total  number,  H,  of 
jobs  circulating  in  the  system.  (If  C > N,  the  CPU 
effectively  has  infinite  capacity  since  no  blocking  can 
occur.)  Other  possible  models  are  left  to  the  reader. 

Since  the  CPU  has  a finite  capacity,  the  potential  exists 
for  blocking  to  occur  at  any  of  the  PP's.  As  discussed  in 
subsection  2.6,  M components  will  be  added  to  the  vector 
representation  of  a state,  one  for  each  PP  to  indicate  its 
blccked/nct  blocked  status.  Hereafter  tnese  M components 
are  called  the  blocking  subvector. 

One  way  to  handle  tnis  situation  is  to  set  a 
component  of  the  blocking  subvector  egual  to 
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corresponding  EP  is  blocked  and  one  if  it  is  not,  and  use 
the  procedures  discussed  in  the  last  subsection.  However, 
since  the  possible  values  of  the  components  are  independent 
of  the  left  subvector,  a more  efficient  scheme  is  possible. 

Using  the  terminolgy  of  subsection  2.6,  assume  that 
a priority  cr  probablistic  scheme  is  being  used  to  determine 
which  of  the  blocked  PP's  will  be  unblocked  when  a service 
completion  takes  place  at  the  CPU.  In  particular,  set  the 
j-th  component  of  the  blocking  subvector  egual  to  one  if  PPj 
is  blocked  and  zero  if  not. 

The  ISTATE  m 1 and  ISTATEm2  vector  representations 
(wi£h  the  blocking  subvector  at  the  right  side)  are 
preferred  over  the  1ST  AT  E vector  representation  for  two 
reasons.  First,  once  the  right  subvector  has  been 
specified,  the  whole  range  of  possible  docking  subvectcrs 
can  be  determined.  Second,  the  fact  that  the  CPU  has  a 
finite  capacity  implies  that  there  is  a positive  minimum 
feasible  value  for  the  sum  of  the  components  of  the  right 
subvector,  i.e.,  the  first  component  of  the  ISTATEml  and 
1ST  AT Em 2 vector  representations. 

Suppose  that  a right  subvector  is  specified.  If  the 
sum  of  its  components  is  greater  than  N - C,  no  blocking  can 
occur.  Sc  consider  the  case  in  whicn  this  sum  equals  K - C. 
If  the  j-th  component  of  the  right  subvector  is  zero,  so  is 
the  j-th  component  of  the  blocking  subvector  since  an  idle 
processor  cannot  be  blocked.  Removing  these  components  from 
the  blocking  subvector,  we  are  left  with  a blocking 
subvector  whose  length  is  the  number  of  nonzero  terms  of  the 
specified  right  subvector.  Each  component  of  this  shortened 
blocking  subvector  can  independently  take  on  either  of  the 
values  zero  cr  one.  Using  the  techniques  for  storage  and 
handling  cf  variable-length  vectors  discussed  in  subsections 
3.4  and  3.5,  these  shortened  blocking  subvectors  could  be 


stored  for  later  use.  Indeed,  this  is  necessary  if  a FIFO 
or  LIFO  unblocking  scneme  is  used.  But  in  the  present  case 
the  fact  that  the  stored  numbers  are  binary  can  be  used  to 
avoid  storing  any  information  at  all  concerning  the  blocking 
subvectors.  If  the  right  subvector  has  m nonzero 

m 

components,  there  are  2 feasible  (shortened)  blocking 
subvectors,  ana  they  are  represented  by  binary 

m 

representations  of  the  integers  from  zero  through  2 - 1. 


Example  2.19 


Suppose  N = 4,  N = 3,  M = 4 and  C = 3. 
1 2 


Consider  the 


right  subvectcr  {2, 1,0,1}.  Since  the  sum  of  the  components 
of  the  right  subvector  is  equal  to  N - C,  the  blocking 
subvector  may  take  on  nontrivial  values.  The  shortened 
blocking  subvector  has  three  components  whose  values 
indicate  whether  or  not  PP1,  PP2 , and  PP4 , respectively,  are 
blocked.  A value  {1,0,1}  indicates  that  ?P1  and  PP4  are 
blocked  but  £E2  is  not.  The  following  table  lists  the 
feasible  (full)  blocking  subvectors  in  lexicographic  order 
and  the  number  which  would  be  stored  to  represent  each  one. 


Blocking 

subvector 


0,0,0, 0 
0,0,0,  1] 
0,1 ,0, 0* 
0,1,0,  1 
1,0  0 0 
1,0,0,  1 
1 , 1 ' 0 ,0, 
1,1,0,  1 


stored 

number 

0 

1 

10 
1 1 
100 
101 
110 
111 


Note  that  the  third  component  of  the  blocking  subvector  is 
zero  since  tte  third  component  of  the  right  subvector  is 
zero,  i.e.,  EP3  cannot  be  blocked  since  it  is  idle.  Also 


note  that  there  are  2 =3  feasible  blocking  subvectors  and 

that  their  ccrres ponding  stored  numoers  are  the  Dinary 
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3 

representations  of  the  integers  0,1,2,.. .,7  =2  - 1.  This 

is  because  three  is  the  number  of  nonzero  components  in  the 
right  sutvectcr. 

As  remarked  above,  the  blocking  subvectors  need  not 
be  stored.  In  fact,  since  the  total  number  of  jobs  at  the 
PP's  may  not  be  smaller  than  M - C,  the  size  of  KSTG  can 
usually  be  reduced.  Seguential  generation  of  the  states  is 
accomplished  by  successively  setting  the  right  subvectcr  to 
the  values  indicated  in  KSTG,  for  each  right  subvector 
successively  setting  the  left  subvector  to  the  feasible 
values  frcm  LSTG,  and  for  each  left  subvector  successively 
setting  the  blocking  subvector  to  its  feasible  values.  This 
last  step  is  accomplished  (in  those  cases  in  which  blocking 
is  possible)  by  successively  setting  the  blocking  subvector 
egual  to  the  binary  representation  of  the  integers  from  zero 
m 

to  (2  - 1)  where  m is  the  largest  feasible  number  of 

blocked  PP's. 


Various  options  are  available  for  determining  state 
numbers  frcm  vector  representations.  First,  note  that  the 
number  of  states  corresponding  to  a given  rignt  subvector  is 
egual  to  the  number  of  lert  subvectors  valid  for  that  right 
subvector  if  the  sum  of  the  components  of  the  right 

m 

subvector  is  larger  than  N - C;  it  is  egual  to  2 times  the 

number  of  valid  left  subvectors  (where  m is  the  number  of 
nonzero  components  in  the  right  subvector)  if  this  sum 
equals  N - C. 


One  procedure  would  be  to  store  in  NSTG4 (i)  the 
number  of  states  preceding  the  first  state  having  KSTG  (i)  as 
its  right  subvector.  A straightforward  algorithmic 
procedure  (see  Algorithm  10  in  Appendix  B)  could  then  be 
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used  to  determine  the  state  number  from  the  vector 
representation.  Of  course,  NSTG4  can  be  shortened  since  the 
number  of  states  having  a given  right  subvector  can  be 
determined  frcra  NSTG2  and  NSTG3  if  the  sum  of  the  components 
of  the  right  subvector  is  larger  than  N - C.  It  can  be 
shortened  further  if  the  states  are  seguenced  according  to  a 
lexicographic  ordering  of  a new  vector  representation,  say 
ISI ATEm3 , which  is  similar  to  the  ISTATEm2  (or  ISTATEml) 
vector  representation  except  that  the  number  of  nonzero 
components  of  the  right  subvector  is  inserted  (as  an 
additional  ccmponent)  between  the  first  two  components, 
i.e.,  between  the  sum  of  the  components  of  the  right 
sufcvectcr  and  the  right  subvector  itself.  Since  the 
techingues  that  would  be  used  in  this  case  are  similar  to 
these  developed  earlier  in  this  section,  we  will  not  discuss 
the  ISTATEb3  vector  representation  further. 

3.9.  Bulking 


A review  of  subsection  2.7  reveals  that  the  possible 
values  of  components  add  to  the  vector  representation  to 
handle  bulking  depends  upon  both  right  and  left  subvectors. 
Hence,  the  procedures  required  for  sequential  generation  of 
the  states  and  determination  of  state  numbers  from  vector 
representations  are  those  discussed  in  subsection  3.7  for 
handling  nenexponential  service  distributions. 

4.  GENERATION  AND  STORAGE  OF  THE  BALANCE  EQUATIONS 

Once  the  states  have  been  appropriately  sequenced  and  an 
efficient  computational  procedure  has  been  developed  to 
translate  state  vectors  into  state  numbers,  the  balance 
equations  may  be  generated  and  stored  for  subsequent 


130 


solution.  For  i = 1,  2,  . ..,  NST ATE,  let  p be  the 

i 

steady-state  probability  taat  the  system  is  in  state  i. 
Then  the  i-tn  balance  equation  has  the  form 


(2.2) 


(rate  of  transition  from  state  i)  p = 

i 


? (rate  of  transition  from  j to  i)  p 


Dividing  (2.2)  through  by  (rate  of  transition  from  state  i)  , 
the  balance  equations  can  be  written  in  more  compact  matrix 
form  as 


(2.3) 


P = AP 


where  P is  the  column  vector  (p  ,p  ,...,p  ) and  A is 

1 2 N STATE 

the  matrix  with  (rate  of  transition  from  j to  i)  divided  by 

(rate  of  transition  from  i)  at  the  intersection  of  the  i-th 
row  and  j-th  column. 


As  will  he  seen  shortly,  A is  often  a very  sparse  matrix 
(i.e.,  a large  proportion  cf  its  elements  are  zeros). 

Hence,  it  is  inefficient  to  store  A in  matrix  form.  Rather 
it  is  suggested  that  only  its  nonzero  elements  and  the 
location  cf  each  be  stored.  This  is  accomplished  by  storing 

(i)  the  k-th  nonzero  element  in  COEF(k)  ; 

(ii)  the  column  number  for  the  k-th  nonzero 
element  in  INDEX  (k)  ; and 

(iii)  the  number  of  nonzero  elements  in  the  first 
i rows  in  NCON  (i)  . 

Thus,  equivalent  to  (2.2)  is 


(2.4) 


P. 

l 


MX 

= 2 

j = MN 


COEF  (j)  p 


INDEX  (j) 


where  MN  = NCCN(i-l)  +1  (MN  = 1 if  i = 1)  and  MX  = NCCN(i). 


Generation  of  the  balance  equations  now  involves  filling 
in  the  three  arrays  COEF,  INDEX  and  NCON.  To  do  this  the 
following  must  be  determined  for  each  state  i: 

(i)  the  rate  cf  transition  from  state  i; 

(ii)  the  various  states  from  which  the  system  can 
transition  (in  one  step)  into  state  i;  and 

(iii)  the  rate  of  transition  from  each  cf  these 
states  into  state  i. 

The  rate  cf  transition  from  state  i (hereafter  called 
DIVRAT)  is  the  sum  of  the  service  rates  of  the  jobs  in 
service  at  the  various  processors.  The  states  from  which 
tne  system  can  transition  into  state  i may  be  determined 
from  the  ISTATE  vector  representation  of  state  i by 
determining  which  job  (or  jobs)  could  have  moved  in  such  a 
transition.  The  rate  of  transition  in  each  such  case  is  the 
service  rate  cf  the  job  which  moved. 


4.1.  Key  Example 


Since  all  processors  are  FCFS,  in  order  for  a job  to 
be  a candidate  for  movement  during  a transition  into  state 
i,  it  must  be  the  leftmost  job  in  the  ISTATE  listing  of  jobs 
at  some  processor. 


Example  2.20 

Let  N = 3,  N =4,  and  M = 2.  For  state  i suppose 

1 2 
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ISTATE  = {1 , 1 ,2 ,2 , 1 / 2 , 2,3 , 3} . Then  there  is  a type-two  job 

in  service  at  each  of  the  three  processors.  Hence,  DIVRAT  = 
RATE  (2,1)  + BATE (2,2)  + BATE  (2,3).  (See  subsection  1.1  for 

definition  of  BATE  and  ALFA.)  There  are  four  states  frcm 
which  the  system  could  transition  into  state  i: 

(i)  Frcm  state  j with  ISTATE  = 

{1 , 1,2, 2,  1, 2, 2, 3 , 4}  by  a type-two  job  at  PP2 

completing  service  and  proceding  to  the  CPU.  Hate 
of  transition  from  j to  i is  RATE(2,2). 

(ii)  Frcm  state  j with  ISTATE  = 

2 

(1  , 1 ,2, 2, 2, 1 , 2, 4 , 3}  by  a type-two  job  at  PP 1 


completing  service  and  proceding  to  the  CPU.  Rate 

of  transition  from  j to  i is  RATE (2,1). 

2 

(iii)  Frcm  state  j with  ISTATE  = 

( 1 , 1, 2,  1, 2,  2, 2,  3,  2}  by  a type-two  job  at  the  CPU 

completing  service  and  proceding  to  PP2 . Rate  of 
transition  frcm  j to  i is  RATE  (2 , 3)  ALFA  (2, 2)  . 

(iv)  Frcm  state  j with  ISTATE  = 

4 

(1 , 2 ,2 , 1 ,2 , 2 , 1 , 2 , 3}  by  a type-one  job  at  the  CPU 


completing  service  and  proceding  to  PP 1 . Rate  of 

transition  from  j to  i is  RATE (1 ,3)  ALFA (1 , 1)  . 

4 


Letting  bN  = NCON(i-l)  + 1,  set: 

COE?  ( M N)  = RATE  (2,2) /DIVRAT 

COE?  (JJN+1)  = RATE  (2,1) /DIVRAT 

COE?  (MN+2)  = RATE  (2,3)  ALFA  (2, 2)/DIVRAT 

COE?  ( KN  + 3 ) = RATE  (1  ,3)  ALFA  (1,  1)  /DIVRAT 


INDEX (UN) 
INDEX (MN+  1 ) 
INDEX (MN+2) 
INDEX (MN+3) 
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NCON(i)  = MN  ♦ 3 

Note  that  the  actual  values  of  i,  j , j , j and  j may  be 

12  3 4 

derived  fica  (2.1)  and  the  respective  ISTATE  vector 

representations.  This  example  should  oe  used  as  a guide  in 
understanding  the  following  examples  which  develop  tne 
balance  aquation  for  a similar  state  i for  various 
generalizations  of  the  key  example. 

4.2.  Generalization  of  the  Number  of  Job  Types 

Exactly  the  same  procedures  are  followed  if  the 
number  of  jot  types  is  increased  beyond  two. 

4.3.  Generalization  of  the  Number  of  Servers 

Example  2.21 

Consider  the  same  situation  as  Example  2.20  except 
that  P?1  is  a multiserver  queue  with  two  servers.  Then 
since  twc  jets  are  in  service  at  PP1 , DIVRAT  has  a different 
value : 

DIVRAT  = RATE  (1,1)  «•  RATS(2,1)  + RATE  (2,2)  + RATE(2,3) 
There  will  also  be  some  change  in  the  balance  equation.  Of 
the  four  terms  listed  in  Example  2.20,  all  but  (ii)  are 
still  valid.  In  the  present  case  it  is  possible  to 
transition  into  state  i from  either  of  the  two  states  by 
having  a type-two  job  complete  service  at  PP1  and  route  to 
the  CPU.  Thus,  (ii)  should  be  replaced  by: 

(ii)  from  state  j with  ISTATE  = 

{ 1 , 1, 2,  2, 2,  1 , 2,  4 , 3}  by  a type-two  job  at  PP1 

completing  service  and  proceaing  to  the  CPU.  Rate 
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of  transition  from  j to  i is  RATE(2,1)x2. 

(ii1)  From  state  j with  ISTATE  = 

2' 

{1  .2, 1,2,2, 1 ,2,4,3}  by  a type-two  job  at  PP 1 

completing  service  and  proceding  to  the  CPU.  Hate 

of  transition  from  j to  i is  RATE(2,1). 

2 * 

4.4.  Generalization  of  Queui nq  Discipline 

Hith  the  exception  of  PS  a change  of  queuing 
discipline  at  cne  or  more  of  the  processors  would  not  effect 
the  value  of  EIVHAT.  HoVev.er,  any  such  change  will  cause 
changes  in  the  ba1 anc  equations.  In  the  following  examples 
toe  same  situation  as  that  examined  in  Example  2.20  is 
considered  with  the  exception  of  the  queuing  discipline 
change  noted  in  each  case.  The  resulting  changes  to  the 
balance  equation  fcr  state  i are  listed. 

Example  2.22 

Suppose  that  the  queuing  discipline  at  PP2  is  LCFS. 
Then  any  lob  arriving  at  PP 2 (from  the  CPU)  will  join  the 
front  of  the  line  rather  than  the  back  as  in  the  FCFS 
discipline.  Thus  (iii)  snould  ne  changed  to: 

(iii)  From  state  j with  ISTATE  = 

{ 1,  1 , 2, 2, 2,  2,  1, 3 , 2}  by  a type-one  job  at  the  CPU 

completing  service  and  proceding  to  PP2 . Rate  of 
transition  from  j to  i is  RATE ( 1 , 3)  ALFA ( 1 , 2)  . 
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Example  2.23 


Suppose  that  type-one  jobs  have  (nonpreempti ve) 
priority  ever  type-two  jobs  at  PP2.  Then,  if  a type-one  job 
were  to  complete  service  at  the  CPU  and  procede  to  PP2  at  a 
time  when  cne  cr  mere  type-two  jobs  were  enqueued  at  PP2, 
the  type-cne  job  would  enter  the  line  in  front  of  all 
(enqueued)  type-two  jobs.  Thus,  in  addition  to  the  four 
terms  listed  in  Example  2,20,  the  balance  equation  in  this 
case  would  have: 

(v)  Free  state  j with  ISTATE  = 

{1 , 1 ,2 , 2,2 ,2 , 1 ,3 , 2}  ov  a type-one  job  at  the  CPU 

completing  service  and  proceding  to  PP2 . Rate  of 
transition  from  j to  i is  RATE ( 1 ,3)  ALFA  (1 , 2)  . 


Example  2.24 


Suppose  that  type-two  joos  have  preemptive  priority 
over  type-one  jobs  at  PP1.  Then,  though  a newly  arriving 
type-two  job  (at  PP 1)  would  not  interrupt  another  type-two 
job  in  service,  it  would  interrupt  a type-one  job  in 
service.  Hence,  tc  the  four  terras  listed  in  Example  2.20 
add : 

(v)  From  state  j with  ISTATE  = 

{1 / 1 , 2 , 1 #2 , 2 , 2, 2 , 3}  by  a type-two  job  at  the  CPU 


completing 

transition 


service  and  proceding  to  PP1.  Rate  of 
from  j to  i is  RATE (2 ,3)  ALFA (2 , 1 ) . 


Example  2.25 

Suppose  that  the  queuing  discipline  at  PP2  is  LCiSPR 
or  LCPSPRpt . Then,  in  contrast  to  Example  2.22,  (iii)  of 
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Example  2.20  must  be  changed  to: 

(iii)  From  state  j with  I5TATE  = 

{1 , 1,2,2,  1,2, 2, 3, 2}  by  a type-two  job  at  the  CPU 

completing  service  and  proceding  to  PP2.  Rate  of 
transiticn  from  j to  i is  RATE  (2 ,3)  ALFA  (2,2)  . 

Both  LCFSPR  and  LCFSPRpt  will  be  discussed  in  conjucticn 
with  generalized  Erlangian  service  distributions. 


Example  2.26 

Suppose  that  the  gueuing  discipline  at  PP1  is  PS. 

Then,  the  value  of  DIVRAT  must  be  changed  by  replacing  the 
first  term  (which  is  RATS(2,1);  see  Example  2.20)  to 
(1/3)  [ 2xBATE  (1 , 1 ) + RATE  (2,1)  ].  Similarly,  since  the  rate 
of  transiticr  from  j to  i now  depends  upon  the  full 

complement  of  jobs  at  PP1  just  prior  to  the  transition,  this 

rate  must  be  changed  to  RATE(2,1)/2. 


4.5.  Generalization  of  Service  Distributions 


Example  2.27 

Suppose  that  the  situation  is  the  same  as  that  in 
Example  2.20  except  that  jobs  at  PP2  ha/e  ncnexponential 
service  distributions.  More  specifically  suppose  that  type- 
one  jobs  have  a service  distribution  which  can  be  modelled 
as  three  exponential  stages  and  that  type-two  jobs  have  one 
which  can  be  modelled  as  two  exponential  stages.  Let 
RAT E (i , 2 , k)  be  the  rate  parameter  for  the  k-th  stage  of  the 
distribution  for  type-i  jobs  (k  = 1,2,3  if  i = 1 and  k = 1,2 
if  i = 2)  and  let  o(i,2,k)  be  the  probability  of  a type-i 
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job  routing  to  the  C?U  immediately  after  completing  stage  <c 

service  at  PE 2 (k  = 1,2  if  i =1  and  k = 1 if  i = 2)  . Expand 

the  ISTATE  vector  by  one  component  on  the  right  to  indicate 

the  stage  of  service  for  the  job  in  service  at  PP2.  Suppose 

that  in  state  i,  the  job  in  service  at  PP2  is  in  its  second 

stage  of  service.  Then,  for  state  i ISTATE  = 

{ 1 , 1 , 2 , 2 , 1 ,2 ,2 ,3, 3 , 2}  and  the  second  term  in  the  calculation 

of  DIVRAT  becomes  HATE  (2, 2, 2).  In  the  generation  of  the 

balance  equation  the  ISTATE  vectors  for  j , j and  j must 

2 3 4 

have  the  additional  component,  with  value  2,  added  on  the 

right.  Since  the  job  in  service  must  have  passed  tnrough 
stage  one,  (i)  must  be  changed  to: 

(i)  Ercm  state  j with  ISTATE  = 

{ 1 , 1 , 2 , 2,  1 , 2, 2, 3, 3, 1}  by  a type-two  job  at  ?P2 

completing  service  and  proceding  to  the  second 
stage  cf  service  at  PP2 . Hate  of  transition  from 
j tc  i is  HATE  (2,2, 1 ) [ 1-B  (2, 2,  1 ) ]. 

If,  on  the  ether  hand,  the  job  in  service  at  ?P2  in 
state  i is  in  its  first  stage  of  service,  then  ISTATE  = 

{ 1 , 1 ,2 , 2 , 1 , 2 ,2 ,3, 3 , 1}  for  state  i and  RATE(2,2,1)  is  the 
second  term  in  the  calculation  of  DIVRAT.  Again  (ii) , (iii) 
and  (iv)  are  as  in  Example  2.20  except  that  the  ISTATE 
vectors  have  an  additional  component  on  the  right  side,  this 
time  containing  a 1.  However,  in  this  case  it  is  possible 
to  transition  into  state  i by  having  a job  complete  service 
at  PP2  and  route  to  the  CPJ.  In  fact,  since  type-two  jobs 
at  PP2  can  complete  service  with  either  of  two  stages,  there 
are  two  different  states  from  which  this  can  occur. 
Specifically,  (i)  can  he  replaced  by: 

(i)  Ercm  state  j with  ISTATE  = 

{ 1 , 1 ,2 , 2,  1 ,2 , 2 ,3 , 4,2 } by  a type-two  job  at  ??2 
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Hate 


completing  service  and  proceding  to  the  CFO. 
of  transition  from  j tc  i is  RATE(2,2,2). 

(i * ) Frcm  state  j with  ISTATE  = 

1' 

{1 , 1,2, 2,  1,2, 2,3,4, 1}  by  a type-two  jot  at  PP 2 

completing  service  and  proceding  to  the  CPU.  Hate 

of  transition  from  j to  i is 

1* 

RATE  (2,2,  1)  B (2,2, 1)  . 


Example  2. 2d 

Suppose  that  the  situation  is  as  described  in  the 
first  paragraph  of  Example  2.27  except  that  PP2  has  LCFSPR 
queuing  discipline.  Then  as  discussed  in  subsection  2.4, 
to  tne  ISTATE  vector  representation  of  each  state  must  be 
added  N = 7 components  to  represent  the  stage  of  service 
each  job  was  in  when  it  last  received  service  (or  is 
currently  in  if  it  is  receiving  service).  Suppose  that  tne 
type-two  jot  enqueued  at  PP2  was  in  its  second  stage  and  the 
type^one  jot  in  its  third  stage.  Then,  for  state  i,  ISTATE 
= ( 1 , 1 , 2, 2,  1,2, 2 ,3 , 3,  1 , 1 , 1 , 2 , 3, 2, 1}  where  the  ones  for  jobs 
not  at  PE2  are  default,  values.  DIVRAT  is  as  described  in 
the  first  paragraph  of  Example  2.27.  The  terms  of  the 
balance  equation  are  determined  by  considering  transitions 
into  state  i. 

(i)  From  state  j with  ISTATE  = 

(1,1, 2, ^,1,2, 2, 3, 4, 1,1,  1,2, 3, 2, 2}  by  a type— two 

job  at  EF 2 completing  service  and  proceding  to  the 

CPU.  Rate  of  transition  from  j tc  i is 

RATE  (2,2,2). 
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(i1)  F ten  state  j with  ISTATE  = 

1' 

{1,  1,2,2, 1,2,2, 3,4,1, 1,  1,2,3, 2,1}  by  a type-two 

job  at  PP2  completing  service  and  proceding  to  the 

CPU.  Rate  of  transition  from  j to  i is 

1 • 

RATE  (2,2,  1)  3 (2,2, 1)  . 

(ii)  Ficm  state  j with  ISTATE  = 

2 

{1, 1,2, 2, 2, 1,2, 4, 3,  1, 1, 1,1, 2, 3, 2}  by  a type-two 

job  at  FF1  completing  service  and  proceding  to  the 

CPU.  Rate  of  transition  from  j tc  i is 

2 

RATE  (2,1). 

(iii)  Eicm  state  j with  ISTATE  = 

{1,1, 2, ^,1,2, 2, 3, 3, 1,1, 1,2, 3, 1,1}  by  a type— two 

job  at  £P2  completing  service  and  proceding  to  the 
second  stage  cf  service  at  PP2.  Rate  of 
transiticn  from  j to  i is 

RATE  (2, 2, 1)  [ 1-3(2, 2,1)  ]. 

(iv)  Frcm  state  j with  ISTATE  = 

4 

{ 1 , ^ , w , 1,2,^,  1,2, 3, 1,1,  2,  3, 2,  1,1}  by  a type— one 

job  at  the  CPU  completing  service  and  proceding  tc 

PP 1 . Hate  of  transition  from  j to  i is 

4 

RATE  (1,3)  ALFA  (1,1). 

Note  that  a transition  suen  as  that  described  in  (iii)  cf 
Example  2.20  is  not  possible  since  any  job  arriving  at  PP2 
would  immediately  enter  the  first  stage  of  service  there. 


140 


I 


Suppose  that  the  situation  is  as  in  the  first 
paragraph  of  Example  2.27  except  that  the  queuing 
discipline  at  PP2  is  LCFSPHpt.  Then,  N + 1 = 6 components 
must  be  added  to  each  1ST ATE  vector.  The  first  seven  of 
these  represent  the  largest  stage  of  service  attained  at  PP2 
by  the  various  jobs  since  last  departing  from  PP2.  (Again 
one  is  used  as  a default  value.)  The  last  component  is  used 
to  indicate  the  current  stage  of  the  job  in  service  at  PP2. 
Suppose  xhat  the  largest  stage  attained  by  the  type-twc  job 
engueued  at  EP2  was  two  and  by  the  type-one  job  enqueued 
there  was  three.  Suppose  that  the  job  in  service  at  PF2  had 
attained  the  second  stage  out  was  interrupted  there  and  is 
currently  in  the  first  stage  of  service.  Then,  for  state  i 
ISTATE  = {1,  1,2,2,  1,2,2, 3,3, 1, 1,1,2, 3,2, 1, 1} . DIVE  AT  is  as 
described  in  the  second  paragraph  of  Example  2.27.  The 
terms  of  the  balance  equation  (compare  with  Example  2.28) 
are  obtained  by  considering  transitions  into  state  i: 

(i)  Frcm  state  j with  ISTATE  = 

{ 1 , 1, 2, 2,  1, 2, 2, 3, 4, 1 , 1 , 1 , 2 , 3, 2, 2 , 1}  by  a type-two 

job  at  EF2  completing  service  and  preceding  to  the 

CPU.  Fate  cf  transition  from  j tc  i is 

SATE  (2, 2,  1)  B (2,2, 1)  . 


(i1)  Eica  state  j with  ISTATE  = 


(1»  1,2, w,  1,2, *,3,4, 1,1,  1,2, 3, 2,  1,1}  by  a type— two 


job  at  EP2  completing  service  and  proceding  to  the 

CPU.  Hate  of  transition  from  j to  i is 

1* 

BATE  (2,2,  1)  B (2,2,  1)  . 
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1 


(i")  From  state  1 with  ISTATE  = 

1" 

{ 1 » 1 # 2 , <,  1,2, 2,3, 4, 1, 1,  1,2, 3, 2, 2, 2}  by  a type- two 

job  at  EE2  completing  service  and  proceding  to  the 

CPU.  Rate  of  transition  from  j to  i is 

1" 

RATE  (2,2,2)  . 

(ii)  Ficm  state  j with  I5TATE  = 

2 

{1,1, 2, ^,2, 1,2, 4, 3, 1,1, 1,1, 2, 3, 2, 1}  by  a type- two 

job  at  EE  1 completing  service  and  proceding  to  the 

CPU.  Rate  of  transition  from  j to  i is 

2 

RATE  (2,1). 

(i ii)  From  state  j with  ISTATE  = 

4 

{ 1 » w,  2,  1/2,2,  1,2,  3,1,  1,2, 3, 2, 1,1,1}  by  a type- one 

job  at  the  CPU  completing  service  and  proceding  tc 

PP 1 . Rate  of  transition  from  j to  i is 

4 

RAT E (1,2)  ALFA  (1,  1)  . 


4.6.  Fir,  ite  Capacities  and  Bloc  king 


Exa  aple  2. 30 

Suppose  that  the  situation  is  as  in  Example  2.20 
except  that  EE2  has  a capacity  of  three  jobs.  Then  to  the 
ISTATE  vector  for  each  state  add  one  additional  component 
which  takes  on  the  value  zero  if  the  CPU  is  not  blocked  and 
two  if  it  is  blocked  (by  a job  which  has  completed  service 
at  the  CPU  but  found  PP2  at  capacity  when  it  tried  to  route 
there) . Finally  suppose  that  in  state  i the  CPU  is  not 
blocked  sc  that  ISTATE  = { 1 , 1 , 2 , 2,  1 , 2, 2 , 3 , 3 , 0) . DIVRAT  has 
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exactly  that  value  specified  in  Example  2.20.  (If  the  CPU 

were  blocked,  DIVRAT  would  be  RATE(2,1)  + RATE(2,2).) 

Turning  new  tc  the  balance  equation,  the  last  three  terms  as 

specified  in  Example  2.20  are  still  valid  with  the  addition 

of  a zero-valued  component  to  the  right  end  of  the  ISTAIE 

vector  for  states  j , j , and  j . The  capacity  of  PP2  makes 

2 3 4 

state  j impossible.  However,  if  the  last  enqueued  jot  at 
PP2  in  state  j were  instead  blocking  the  CPU,  a transition 
of  the  type  described  in  (i)  of  Example  2.20  would  cause 


simultaneous  movement  of  tnis  job  to  PP2  and  result  in  state 
i.  That  is,  (i)  can  be  replaced  by: 

(i)  Ercm  state  j with  ISTATE  = 


{1  , 

com 

sim 

CPU 

tra 


1,2, 1,2,2, z, 

pleting  serv 
ultaneous  mo 
to  EP2 , unn 
nsiticn  from 


3,3,2}  by  a 

ty pe-two 

job 

at  PP  2 

ice  and  proceding  to 

the 

CPU  and 

vement  of  a 

type-two 

job 

from  the 

locking  the 

CPU.  Rat 

e of 

j to  i is 

RATE  (2  ,2) 

• 

4.7.  Euiking 


Example  2.31 

Suppose  that  the  situation  is  as  Example  2.20  except 
that  type-one  jobs  destined  for  PP1  bulk  at  the  CPU  and 
depart  only  in  pairs.  Then,  to  the  ISTATE  vector  for  each 
state  add  one  additional  component  which  indicates  the 
number  of  type-one  jobs  in  the  bulking  queue  at  CPU. 

Clearly,  for  state  i,  ISTATE  = { 1, 1 ,2, 2, 1 , 2, 2,3, 3, 0} . 

DIVRAT  ana  the  first  three  terms  of  the  balance  equation  are 
(with  the  obvious  change  to  the  appropriate  ISTATE  vectors) 
as  indicated  in  Example  2.20.  In  fact,  even  (iv)  is  correct 
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if  the  ISTATE  vector  for  j is  changed  to 

4 

{2,  2,  1, 2 , 2 , 1 , 1 , 1, 3 , 1)  and  the  wording  is  changed  slightly  to 
indicate  that  two  type-one  jobs  proceed  to  PP1. 

5.  PROPERTIES  OF  THE  SYSTEM  OF  EALANCE  EQUATIONS 

In  this  chapter  concepts  and  techniques  designed  tc  aid 
in  the  scluticn  of  the  variety  of  queuing  network  problems 
have  been  introduced.  Many  of  these  problems  do  not  satisfy 
local  balance  and  therefore  are  generally  net  known  to  have 
simple  clcsed-fora  solutions,  such  as  the  product- form 
solutions.  More  specifically,  this  chapter  has  been 
ccncerned  with  hew  to  conveniently  specify,  arrange  and 
store  the  states  of  such  problems  and  how  to  generate  tne 
balance  equations.  Solution  of  these  balance  equations  is 
the  subject  of  the  next  chapter. 

The  approach  has  been  to  introduce  the  concepts  and 
techniques  with  a view  toward  eventual  implementation  cn 
high-speed  digital  computers.  The  reason  is  simply  that  the 
size  of  the  problems  encountered  in  modeling  even  simple 
systems  is  very  large.  For  example,  the  case  considered  in 
Example  2.20,  two  types  of  jobs  with  three  jobs  of  one  type 
and  four  cf  the  other  circulating  in  a central-server  model 
consisting  cf  a FCFS  single-server  CPU  and  two  FCFS  single- 
server PP's,  yields  1260  states  and  3920  nonzero  entries  in 
the  transition  matrix.  Increasing  the  number  of  PP's  to 
four  increases  the  state  space  to  11,550  and  the  number  of 
nenzero  entries  to  53,800. 

Some  of  the  generalizations  discussed  in  this  chapter 
will  decrease  the  state  space  and  others  will  increase  it. 
For  example,  giving  a PS  queuing  discipline  cr  multiple 
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servers  tc  a queue  tends  to  decrease  the  state  space.  On 
the  other  hand,  the  state  space  will  be  increased  by 
introduction  of  mere  job  types  (even  though  the  total  number 
of  jobs  remains  unchanged)  or  by  any  generalization  which 
increases  the  size  of  the  ISTATE  vector,  for  example, 
blocking,  bulking,  most  preemptive  queuing  disciplines  and 
generalized  Erlangian  service  distributions. 


Aside  from  potentially  massive  size,  an  important 
feature  of  these  problems  is  the  sparseness  of  the 
transition  matrix.  This  is  seen  in  the  examples  in  section 
4 where  the  maximum  number  of  nonzero  entries  in  each  row  is 
seen  to  be  around  four  or  five  no  matter  what  the  number  of 
states  is.  Two  measures  of  sparseness  are  the  average 
number  of  nerzero  entries  per  row  of  the  matrix  (3920/1260  = 
3.1  and  58,800/11,550  = 5.1  for  the  examples  above)  and  the 

2 

proportion  of  nonzero  entries  in  the  matrix  (3920/(1260)  = 

2 

.0025  and  58,800/(11,550)  = .00044  for  the  examples 

above)  . 


In  the  opening  section  of  this  chapter  it  was  hinted 
that  the  techniques  introduced  here  could  be  applied  tc  a 
more  general  class  of  networks  than  the  central-server  model 
for  which  they  were  introduced.  Doing  so  will  increase  the 
sparseness  measures  (i.e.,  increase  the  number  of  terms  in 
the  balance  equations)  without  affecting  the  size  of  the 
state  space.  The  more  specific  setting  of  the  central- 
server  models  was  used  here  to  simplify  the  presentation  and 
necause  of  the  applicability  of  tne  central-server  models  to 
modelling  cf  computer  systems. 


In  addition,  seme  of  the  other  properties  of  the 
central-server  models  allow  analysis  which  may  not  be 
possible  in  acre  complex  models.  For  example,  a central- 
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server  model  with  two  job  types  and  at  least  two  PP's  is 
guaranteed  to  be  irreducible.  If,  in  addition,  all  service 
distributions  are  exponential,  the  resulting  Markov  chain 
can  be  shewn  to  be  periodic  of  order  two.  These  two  facts 
are  proved  in  Appendix  C. 

The  techrigues  discussed  in  this  chapter  have  been  used 
in  programming  the  key  example  and  two  generalizations  for 
use  on  a high-speed  digital  computer.  The  program  for  the 
key  example  is  given  in  Appendix  D.  One  generalization 
gives  the  CPU  a PS  queuing  discipline.  This  program  is 
given  in  Appendix  E.  The  other  generalization  retains  the 
FCFS  discipline  at  the  CPU  but  has  the  capability  to  make 
the  CPU  a multiserver  processor.  In  addition,  one  of  the 
PP's  in  this  model  has  an  IS  discipline  and  can  accept  only 
one  type  cf  job.  This  program  is  given  in  Appendix  F.  All 
three  models  are  discussed  in  Chapter  IV. 

The  fact  that  these  three  models  are  central-server 
models  with  exponential  service  times  guarantees  that  they 
are  irreducible  and  periodic  of  order  two.  This  periodicity 
is  used  to  advantage  in  discussing  the  convergence 
properties  of  the  solution  methods  presented  in  the  next 
chapter. 


III.  SOLUTION  OF  THE  EA LANCE  EQUATIONS 


The  gcal  of  this  chapter  is  to  present  a variety  of 
procedures  suitable  for  solution  of  the  balance  equations 
which  result  from  application  of  the  concepts  and  techniques 
discussed  in  the  preceding  chapter.  In  view  of  the 
properties  of  these  systems  of  equations  (see  section  5 of 
Chapter  II) , the  main  concern  is  determination  of  a 
procedure  which  is  guaranteed  to  provide  a solution  for  a 
cyclic  model.  In  addition,  a procedure  which  preserves  the 
sparse  nature  of  the  system  will  allow  solution  of  larger 
problems . 

In  the  first  section  of  this  chapter  the  choice  of  a 
solution  cethcd  is  discussed  in  the  light  of  these 
considerations.  The  resulting  choice  is  an  iterative 
method.  Ihis  section  also  serves  as  an  introduction  tc  the 
analysis  of  various  solution  methods  by  introducing  the 
problem  as  an  eigenvalue/eigenvector  problem.  The  second 
section  introduces  the  notation  used  in  the  remainder  cf  tne 
chapter  and  reviews  pertinent  matrix  terminology  and 
theorems.  The  third  section  examines  the  eigenstructure  of 
the  matrices  resulting  from  some  of  the  central-server 
models  discussed  in  the  preceding  chapter.  Finally,  section 
4 is  devoted  to  various  iterative  solution  methods  and 
conditions  under  whicn  they  are  guaranteed  to  converge. 
Subsection  4.4  indicates  the  areas  in  which  further  research 
may  be  useful  in  accelerating  the  convergence  of  the  method 
ultimately  chosen  as  preferred  for  the  pronlems  of  interest 
to  the  author. 


147 


1.  CHOICE  OE  A SOLUTION  METHOD 


The  system  of  balance  equations  discussed  in  the 
preceding  chapter  is  a system  of  homogeneous  linear 
equations.  This  fact  is  most  easily  seen  to  be  true  from 
equation  (2.3)  which  is  repeated  here: 

(3.1)  P = AP 

and  which  can  be  rewritten  as: 

(3.2)  (I  - A)  P = i 

In  these  twc  equations  A and  I are  square  n x n matrices 
(where  n is  the  number  of  states)  and  P and  _(  are  column 
vectors  cf  length  n;  I is  an  identity  matrix  and  all 
components  of  C are  zero.  The  nonzero  elements  of  A are  the 
Hummers  stored  in  the  array  COEF  as  discussed  in  section  4 
of  the  preceding  chapter. 

(Since  the  primary  references  in  this  chapter  are  books 
on  numerical  analysis,  the  numerical  analysts'  emphasis  cn 
column  vectors,  ratner  than  the  probabilists ' emphasis  on 
rcw  vectors,  is  adhered  to  here.  As  will  be  seen  in  section 
3,  our  expression  cf  the  problem  is  the  transpose  of  that 
normally  adopted  by  the  probabalists . Hence,  with  due 
apology  tc  these  who  may  be  confused,  we  assure  the  reader 
that  we  are  investigating  the  forward  equations  (see  Feller 
[32],  Chapter  XIV,  section  7)  and  not  the  backward  equations 
as  it  may  at  first  appear.) 

As  a system  cf  homogeneous  linear  equations,  (3.1)  must 
have  either  an  infinite  number  of  solutions  cr  no  solution 
at  all.  Cf  course,  the  goal  here  is  to  determine  a solution 
for  (3.1)  which  satisfies  two  other  conditions: 

lad 


vector  of 


(3.3) 

J.P  = 

1 

where  2 is  th«= 

row 

component 

s are 

one 

(3.4) 

P > 

0 

Equation 

(3.3) 

is 

Two  c 

p ticns 

ar 

(3.2)  and 

(3.3) 

co 

length  n all  of  whose 


overdeterained  system  cf  linear  equations  could  ne  solved. 
Obtaining  a solution  (hopefully),  satisfaction  of  (3.4) 
could  be  tested.  Second,  (3.2)  could  be  viewed  as  an 
eigenvector  problem  and  an  attempt  could  be  made  to  find  a 
right  eigenvector  cf  A,  corresponding  to  the  eigenvalue  1, 
which  also  satisfies  (3.4).  Normalizing  (i.e.,  dividing  the 
eigenvector  by  the  sum  of  its  components)  would  yield  the 
desired  result.  Extensive  literature  provides  a large 
variety  cf  scluticn  methods  for  both  the  linear  equation 
problem  and  the  eigenvalue/eigenvector  problem.  For 
example,  see  Householder  [53]  and  Wilkinson  [lit].  Because 
of  the  structure  of  the  matrix  A in  (3.1),  the 
eigenvalue/eigenvector  approach  was  selected. 


Whether  the  linear  equation  proolem  or  the 
eigenvalue/eigenvector  proolem  is  chosen,  the  solution 
techniques  fall  into  three  categories:  direct,  iterative, 
and  semi-iterative.  An  iterative  method  of  solving  the 
problem  was  chosen.  The  reason  for  this  choice  was 
three-fold.  First,  the  iterative  metnods  are,  in  general, 
easier  tc  program.  Second,  there  is  not  as  great  a problem 
with  -teund-cff  as  there  is  with  the  direct  methods.  (See 
Dorn  and  McCracken  [23].)  Finally,  the  iterative  methods, 
combined  with  sparse  matrix  storage  techniques,  generally 
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require  less  storage  to  solve  a given  problem  than  do  the 
the  direct  and  sem i- iterative  methods.  Many  of  these  latter 
methods  use  row  and  column  operations  on  the  coefficient 
matrix.  The  result  is  that  many  of  the  elements  which  were 
originally  zero  are  replaced  by  nonzero  elements  and 
therefore  require  storage.  This  phenomenon  is  referred  to 
as  "fill"  in  the  literature.  In  addition,  most  direct  and 
semi-iterative  methods  require  storage  of  the  coefficient 
matrix  in  a form  which  is  less  efficient  than  that  discussed 
in  secticn  4 cf  the  preceding  chapter. 

On  the  ether  hand,  the  iterative  methods  generally 
require  longer  running  times.  This  disadvantage  is  somewhat 
diminished  by  the  fact  that  the  best  direct  methods  take 
time  to  search  and  rearrange  tne  rows  and/or  columns  of  the 
coefficient  matrix  in  an  effort  to  reduce  fill  and  the  fact 
that  space,  and  not  time,  is  the  constraint  in  many  large 
problems . 

For  a comprehensive  treatment  of  iterative  and 
semi-iterative  methods  the  reader  is  referred  to  Varga  [106] 
cr  Young  [114]. 


2.  MATFIX  PBELIHINA RIES 


The  nctaticn  and  some  of  the  elementary 
matrix-theoretical  results  used  in  succeeding  sections  of 
tais  chapter  are  discussed  in  this  section.  In  the  first 

t 

subsection  much  of  the  notation  used  in  this  chapter  is 
defined.  The  second  subsection  is  aeveted  to  permutation, 
irreducible  and  cyclic  matrices  and  the  final  subsection,  to 
eigenvalues  and  eigenvectors. 
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2.1 


Notation 

In  general,  upper  case  letters  at  the  beginning  of 
the  alphabet  will  denote  matrices,  upper  case  letters  at  the 
end  of  the  alphabet  will  denote  vectors,  and  lower  case 
letters  will  denote  scalars  and  functions.  If  A is  a 
matrix,  the  element  in  the  i-th  row  and  the  j-th  column  of  A 
wili  be  denoted  a . Similarly,  the  i-th  component  of 

i j 

vector  X will  be  denoted  x . The  statement  "A  is  an  m x n 

i 

matrix"  means  that  A is  a rectangular  matrix  with  m rows  and 

n cclumns.  The  statement  "A  is  a matrix  of  order  n"  means 
that  A is  a sguare  matrix  with  n rows  (and  columns) . 

Although  the  interest  here  lies  primarily  in  the  area  of 
square  matrices  having  real  elements,  many  of  .he  results 
are  also  valid  for  matrices  having  complex  elements,  and  at 
times  rectangular  matrices  will  be  dealt  with. 

A matrix  cr  vector  is  described  as  real,  positive, 

ncnnegative,  complex,  etc.  according  to  wnether  its 

elements  are  real,  positive,  nonnegative,  complex,  etc.  For 

T * 

any  matrix  A,  A denotes  the  transpose  of  A,  A denotes  the 

complex  conjugate  cf  A,  and,  if  A is  sguare  and  nonsingular, 

-1 

A is  the  inverse  of  A.  If  X is  a vector,  t a scalar  and  f 

T * * -1  * -1 

a function,  then  X , X , t , t , f and  f are  similarly 

defined.  Whether  a vector  is  a row  vector  or  a column 
vector  will  usually  be  clear  from  the  context. 

The  following  special  notation  is  used  throughout 
this  chapter: 

(i)  I = the  identity  matrix  (order  to  be  inferred 
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from  context) 


(ii)  I = the  identity  matrix  of  order  n. 

n 

(iii)  ja  = the  matrix  of  order  n all  of  whose 

n 

elements  are  zero. 

\ 

(iv)  $ - a matrix  (in  general,  rectangular)  all  of 
whose  elements  are  zero. 

(v)  ( = a null  vector  = a vector  all  of  whose 
components  are  zero. 

(vi)  N = {1,2,...,n}  = the  set  consisting  of  the 

n 

first  n positive  integers. 

Ihe  first  part  of  Definition  3.1  follows  that  cf 
Hal mos  [ 48  ]. 

Definition  3_._1  Let  I be  any  set.  A partition  of  T 

is  a collection  of  nonempty  subsets  of  T,  {S  } , such  that 

i iej 

each  element  cf  T is  in  exactly  one  S . If  J = N fcr  some 

1 n 

positive  integer  n and  I is  a set  of  real  numbers,  then 
{S  } is  called  an  ordered  partition  if  each  element  of  S 

i iej  ~ i 

is  smaller  than  each  element  of  S for  i = 1,2,...  n-1. 

i + 1 

If  A is  an  m x n matrix,  consideration  may  be  given 
tc  a partition  of  A as: 
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(3.5) 
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A 

• 00  A 

t si 

s 2 

stJ 

where  the  A are  (rectangular)  matrices  called  subaatrices 

i j 

cf  A.  Formally,  this  situation  may  be  described  by  letting 

s t 

{S  } be  an  ordered  partition  cf  N and  {I  } be  an 
k k=1  a k k=1 


ordered  partition  cf  X . Then,  q € S and  r e T iff  a is 

n k h qr 


one  of  the  elements  of  the  submatrix  A 


In  the  cases 


considered  here,  A will  be  a square  matrix  and  the 

partitions  {S  } and  {T  } will  be  identical.  As  a result, 
k h 

the  submatrices  on  the  aain  diagonal  will  be  square. 


In  a similar  way  partitioning  a vector  into 
subvectors  will  be  considered.  If  a matrix  A is  under 
consideration  and  has  been  partitioned  as  in  (3.5) , and  if  a 
ITT  T 

vector  X = (X  , X , ...,  X ) is  introduced,  then  X has  n 
1 2 t 

components  acd  can  be  assumed  to  have  been  partitioned  in 


such  a manner  that  tne  product  A X is  well  defined.  That 

kh  h 


is,  the  product  AX  is  given  by: 
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(3.6) 


For  a row 
similarly 


j- A X 

+ 

A X 

♦ ... 

+ 

A X 

11 

1 

12  2 
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A X 

♦ 

A X 
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♦ 

A X 
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22  2 

2t  t 
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1 
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3t  t 
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♦ 
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+ 

A X 

Si 

1 

s2  2 

st  t-1 

vector  Y = (Y  , Y , ...  , Y ) the  product 
12  s 

defined. 


YA  is 


2.2.  Special  Types  of  Matrices 

Per  background  reading  on  permutation  matrices,  the 
reader  is  referred  to  Birknoff  and  MacLane  [12].  For 
background  reading  on  irreducible  matrices,  see  Varga  [106] 
or  Young  [114].  Fcr  background  reading  on  cyclic 
irreducible  matrices,  see  Feller  [31]  or  Gaver  and  Thompson 
[44],  Although  Varga  has  an  excellent  discussion  of  cyclic 
irreducible  matrices,  the  development  here  is  more  closely 
related  tc  the  discussion  of  periodic  states  of  a Markcv 
chain  as  found  in  these  other  references. 

Definition  3 . 2 A permutation  matrix  is  a matrix 
each  of  whose  elements  is  either  a zero  or  a one,  and  each 
row  of  which,  and  each  column  of  which,  contains  exactly  one 
nenzero  element. 

Several  facts  concerning  permutation  matrices  are 
new  listed  without  proof.  Let  M be  a permutation  matrix. 

(i)  M is  square  and  nonsingular. 

- 1 T 

(ii)  M = !i  is  a permutation  matrix. 

(iii)  Premultiplication  of  a column  vector,  or 

postoultipiication  of  a row  vector,  by  M has  the 
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effect  of  rearranging  the  components  of  the 
vector. 

(iv)  Premultiplication  (postmultiplication)  of  a 
matrix  by  M has  the  effect  of  rearranging  the 
order  of  its  rows  (columns) . 

(v)  Premultipiication  of  a square  matrix,  A,  by  M 

-1 

and  fostmu  Itiplication  of  the  result  by  M has 

the  effect  of  rearranging  the  rows  and  columns  of 
A in  the  same  way.  If  the  i-th  row  and  i-th 
column  cf  A correspond  to  a state  (e.g.,  if  A is 
a transition  matrix;  or  if  A is  a coefficient 
matrix  as  described  in  section  4 of  the  preceding 
chapter) , then  the  effect  is  a renumbering  of  the 
states. 

(vi)  The  product  of  M and  another  permutation 
matrix  results  in  a permutation  matrix. 

Definition  3._3  If  M is  a permutation  matrix  of 
order  n,  the  permutation  function  associated  with  d is  a 

function  f frcm  N to  N such  that  f (i)  = j iff  m = 1. 

n n i j 

Seme  properties  of  permutation  functions  are: 

(i)  If  f is  the  permutation  function  associated 
with  H , then  f is  a well  defined,  one-to-one,  onto 
function . 

(ii)  If  r is  the  permutation  function  associated 

-1 

with  M , then  f is  the  permutation  function 

-1 

associated  with  M 

(iii)  Properties  (iii)  , (iv)  and  (v)  of  the 
permutation  matrix  M can  be  expressed  more 
explicitly  in  terms  of  the  permutation  function  f 
associated  with  H.  For  example,  if  A is  a matrix 
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-1 

of  order  n,  and  9 = SAM  , then  b = a 

ij  r(i)f(j) 

for  all  i and  j in  N . 

n 


Cef inition  3j_u  a matrix  A of  order  n is  irreducible 

if  n = 1 or  if  n > 1 and,  given  any  partition  {S,  X}  of  X , 

n 

there  is  an  i in  S and  a j in  T such  that  a #0. 

ij 


Each  of  the  following  two  conditions  is 
equivalent  tc  irre ducibilit y of  a matrix  A of  order  n: 

(a)  There  does  not  exist  a permutation  matrix  M such 
- 1 

that  MAM  has  the  form 


i1"  * ' 

(3.7)  BAM  = | 

I A A 
1-21  2 2J 


where  A and  A are  square  matrices. 

1 1 22 

(b)  Either  n = 1 or  n > 1 and,  given  any  two  numbers  i 

and  j in  K , either  a i*  0 or  there  exist  i , i , . . . , i 
n ij  12s 

all  in  N such  that 
n 

a a ...  a * 0 
ii  i i i j 
112  s 


Eroof  of  Theorem  3.1  is  found  in  Young  [114]. 


In  terms  of  stochastic  modelling  terminology  (see 
Feller  T31]  cr  Gaver  and  Thompson  [44])  part  (b)  of  Theorem 
3.1  says  that  the  transition  matrix  (and  the  system  as  well) 
is  irreducible  iff  given  any  two  states  i and  j,  it  is 
possible  tc  get  from  i to  j in  a finite  number  of 
transitions. 
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Theorem  3^2  If  A is  a matrix  of  order  n and  if  for 

any  two  elements,  i and  j,  of  N there  exists  an  integer  m 

n 

(possibly  dependent  upon  i and  j)  such  that  the  element  in 

m 

the  i-th  row  and  j-th  column  of  A is  nonzero,  then  A is 

irreducible.  Furthermore,  if  A is  nonnegative,  the  reverse 
implication  is  also  true. 


Proof : Both  parts  are  a direct  conseguence  of  (b) 

of  Theorem  3.1. 

Definition  3^5  An  irreducible  matrix  A of  order  n 
is  said  to  be  cyclic  with  period  k,  or  k-cyclic.  (where  k > 

k 

1 is  an  integer)  if  there  is  a partition,  (S  } , of  N 

i i=1  n 


such  that  if  a * 0,  then  either 

ij 

(a)  i is  in  S and  j is  in  S ; or 

1 k 

( b)  i is  in  S and  j is  in  S for  some  m * 1 in 

m m- 1 


and  if  there  is  no  decomposition  of  N into  k ' > k subsets 

n 

having  tnis  same  property. 


Theorem  3^3  If  A is  a k-cyclic  matrix  of  order  n, 
then  there  is  a permutation  matrix  X such  that 


r0 

0 

0 

• • • 

St 

A 1 

n 

1 

1 

A 

0 

0 

• • • 

0 

S» 

2 

n 

2 

-1 

(3.8) 

MAM  = 

0 

A 

0 

• • • 

0 

St 

3 

n 

3 

0 

0 

0 

• • • 

A 

0 

k 

n 

k-J 

i 

where  n 

♦ n ♦ . . 

♦ n 

= n 

and 

all 

of  the 

nonzero  elements 

of  A are  contained  in  the  submatrices  A , . ..,  A . 

1 k 


Ercof:  Let  {S  } be  the  partition  cf  N provided 

i i=  1 n 

for  in  Definition  3.5.  Let  n be  the  number  of  elements  of 

i 

S for  i = 1,2,...,k.  Put  the  n.  elements  of  N into  a 
i n 

vector  V cf  length  n such  that  the  n elements  of  3 are 

1 1 

listed  first,  then  the  n elements  of  S , and  so  forth. 

2 2 


Define  a aatrix  M by  letting  a = 1 if  v = j and  m = 0 

ij  i ij 


otherwise.  Since  {S  } is  a partition  of  N , M is  a 

i i=  1 n 

permutation  aatrix.  Let  f be  the  permutation  function 


associated  with  tl.  Note  that  f ( i)  = j iff  m =1  iff  v = 

ij  i 


j.  Thus,  f (i)  = v for  i = 1,2,  ...,n.  Letting  B = MAM 

i 


-1 
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and  using  property  (iii)  of  permutation  functions. 


13 

a . Suppose  b * 0 and  1 < i < n . Then,  f(i)  = v 

tU)f(j)  ij  1 i 

is  in  S . By  (a)  of  Definition  3.5,  f (j)  = v is  in  S so 
1 j k 

that  n - n < j < n.  That  is,  b must  be  in  A . The 
k ij  1 

remainder  of  the  theorem  follows  through  similar  use  of  (b) 
of  DefiniticE  3.5. 


The  matrix  on  the  right  side  of  (3.8)  illustrates 

what  will  hereafter  be  called  the  first  canonical  form  for  a 

k-cyclic  matrix.  Companion  to  this  is  a second  canonical 

form  which  has  all  of  its  nonzero  elements  in  the 

sulmatrices  immediately  above  the  main  diagonal  matrices  and 

in  the  sutmatrix  in  the  lower  left  hand  corner.  This  second 

canonical  form  will  not  be  discussed  in  this  thesis.  Note 

that  these  twc  forms  coincide  if  k = 2 . Hereafter,  the 

statement  "A  is  a k-cyclic  matrix  of  order  n in  first 

canonical  fern”  will  imply  that  A is  an  irreducible  matrix 

which  satisfies  (3.8)  with  M = I . 

n 


In  the  case  that  the  period  of  the  irreducible 
matrix  A is  two,  a third  canonical  form  is  also  of  interest. 
The  statement  "A  is  a cyclic  irreducible  matrix  of  order  n 
in  third  canonical  form"  will  imply  that  the  period  ox  A is 
two  and  there  is  an  integer  k (2  < k < n)  such  that 
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1 

r0 

n 

1 

A 

12 

0 

0 

...  0 

0 1 

1 

A 

2 1 

0 

n 

2 

A 

23 

0 

• 00 

0 

Ui 

» 

vo 

p* 

II 

0 

A 

32 

0 

n 

3 

A 

34 

0 0 0 

0 

i 

0 

0 

0 

0 

0 0 0 A 

k,k-1 

0 

n 

kJ 

where  n + n + 

1 2 

• • • 

* n 

k 

= n . 

An 

example  of  a 

Markov 

transition  matrix  exhibiting  this  form  is  provided  in  Feller 

[31],  chapter  XV,  section  2,  example  (e)  where  the  Ehrenfest 
mcdel  of  diffusion  is  discussed.  In  this  example  k = n.  If 
k = 2,  the  third  canonical  form  coincides  with  the  first  and 
seccnd . 


2.3.  Eigenvalues  and  Eigenvectors 

for  background  reading  on  the  subject  of  this 
subsection,  the  reader  is  referred  to  Wilkinson  [111], 
Throughout  this  subsection  A is  a matrix  of  order  n. 

Definition  3.6  The  complex  number  t is  an 

eigenvalue  of  A if  the  matrix  (A  - tl  ) is  singular.  Ihe 

n 

polynomial  f (t)  = det  (A  - tl  ) is  called  the  characteristic 

n 

polynomial  of  A.  If  t is  an  eigenvalue  of  A,  then  any 
ncnnull  vector  X satisfying  the  equation: 

(3.10)  XA  = tX  (or  equivalently,  X (A  - tl  ) = _C) 

n 
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is  a left  eigenvector  of  A corresponding  to  t , and  any 
nonnull  eigenvector  Y satisfying: 

(3.11)  AY  = tY  (or  eguivalently , (A  - tl  ) Y = () 

n 

is  a right  eigenvector  of  A corresponding  to  t. 

The  following  are  properties  of  eigenvalues  and 
eigenvectors.  Although  in  most  cases  similar  statements 
hold  for  left  eigenvectors,  the  properties  and  theorems  of 
this  subsection  will  be  stated  in  terms  of  right 
eigenvectors  only. 

(i)  The  eigenvalues  of  A are  the  roots  of  f(t)  = 0 
where  f (t)  is  the  characteristic  polynomial  of  A. 
Hence,  there  are  at  most  n distinct  eigenvalues. 

(ii)  Corresponding  to  each  eigenvalue  cf  A there 
is  at  least  one  right  eigenvector. 

(iii)  Any  linear  combination  of  right  eigenvectors 
of  A corresponding  to  a given  eigenvalue  is  also 
an  eigenvector  of  A corresponding  to  that 
eigenvalue.  In  particular,  any  (nonzero)  scalar 
multiple  of  a right  eigenvector  is  also  a right 
eigenvector. 

(iv)  If  t , t , ...,  t are  distinct  eigenvalues 

12k 

of  A and,  for  each  i = 1,2, ...,k,  X is  a right 

i 

eigenvector  cf  A corresponding  to  t , then  the 

i 

vectors  X , X , ...»  X are  linearly  independent. 

1 2 k 

(v)  If  t is  an  eigenvalue  of  A and  X is  a rignt 

eigenvector  cf  A corresponding  to  t,  then  t is  an 

IT  T 

eigenvalue  of  A , X is  a left  eigenvector  of  A 

* * 

corresponding  to  t,  t is  an  eigenvalue  cf  A , and 
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p 


* * 

X is  a right  eigenvector  of  A corresponding  to 

* 

t . 

(vi)  If  A is  real,  then  t is  an  eigenvalue  of  A 
* 

iff  t is  an  eigenvalue  of  A. 

T 

(vii)  If  A is  real  and  symmetric  (i.e.,  A = A)  , 


then  all  of  the  eigenvalues  of  A are  real. 

Theorem  3^4  Let  t be  an  eigenvalue  cf  A and  let  X 
be  a right  eigenvector  of  A corresponding  to  t.  Then  for 
any  nonsingular  matrix  B of  order  n,  t is  an  eigenvalue  of 

-1  -1 

BAB  and  BX  is  a right  eigenvector  of  BAB  corresponding 


to  t. 


Since  X is  a right  eigenvector  of  A 
corresponding  to  t,  tX  = AX.  Hence,  tBX  = B(tX)  = B(AX)  = 

-1 

BA  (I  X)  = (EAE  ) (EX)  . 
n 

Of  particular  interest  in  Theorem  3.4  is  the  case  in 
which  B is  a permutation  matrix.  In  that  case  (see  property 

-1 

(iii)  of  permutation  matrices) , the  eigenvectors  of  EAB 

are  identical  to  those  of  A except  that  the  crder  of  tbe 
components  are  rearranged  in  a manner  which  can  be  specified 
in  terms  cf  the  permutation  function  associated  with  B.  In 
view  of  property  (v)  of  permutation  matrices.  Theorem  3.4 
indicates  the  effect  of  renumbering  the  states  on  the 
eigenvalues  and  eigenvectors  of  the  transition  or  rate 
matrix  or  a Markov  chain. 

Ihe  following  theorem  is  stated  without  proof  since 
the  proof  is  a simple  verification. 
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Theorem  3. 5 Let  & be  a k-cyclic  matrix  of  order  n 
in  first  canonical  form.  Then  t is  an  eigenvalue  of  A and  X 

T 

is  a right  eigenvector  of  A corresponding  tc  t,  where  X = 

IT  I 

(X  »X  »...#X  ) / iff 
12  k 

AX  if  a = 1 

1 k 

(3.12)  tX  = 

m 

AX  if  m = 2,3,...,k 

a m- 1 

Returning  to  equation  (3.2),  it  is  seen  that  the 
eigenvalue/eigenvector  problem  alluded  to  in  section  1 is 
determination  of  a right  eigenvector  of  the  coefficient 
matrix  A corresponding  to  the  eigenvalue  1.  As  indicated  in 
the  next  section.  Per rcn-Frobenius  theory  provides 
guarantees  that  1 is  an  eigenvalue  and  that  a right 
eigenvector  of  A corresponding  to  the  eigenvalue  1 exists 
which  also  satisfies  (3.4). 

3.  EIGENS1R0C1URE  0?  THE  CENTRAL  SERVER  MODELS 

Before  considering  the  solution  methods  to  be  discussed 
in  the  next  section,  it  is  helpful  to  knew  something  about 
the  eigenvalues  and  eigenvectors  of  the  coefficient  matrix  A 
of  equation  (3.1).  Recall  that  the  objective  is  to  find  a 
right  eigenvector  cf  A corresponding  to  an  eigenvalue  cf  one 
and  satisfying  both  (3.3)  and  (3.4).  The  first  question 
should  be,  "Is  one  an  eigenvalue  of  A?"  Then,  "Is  there  a 
nennegative  right  eigenvector  of  A corresponding  to  one?" 

If  so,  property  (iii)  of  eigenvalues  and  eigenvectors 
guarantees  that  it  can  be  normalized  (i.e.,  divided  by  the 
sum  of  its  components)  and,  thereby,  one  can  be  found  which 
satisfies  (3.3)  as  well.  Recalling  the  definition  of  F as 
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the  steady-state  probability  distribution  for  the  system, 
the  next  question  should  be,  "Is  this  right  eigenvector  of  A 
corresponding  to  one  and  satisfying  (3.3)  and  (3.4)  unique 
with  respect  to  these  properties?" 

Note  that  these  three  questions  are  exactly  those  which 
are  answered  by  the  standard  theorems  concerning  existence 
of  an  invariant  distribution  for  an  irreducible  Markov  chain 
with  only  persistent  states.  (See  Feller  [31],  Chapter  XV, 
sections  7 and  9.)  Despite  the  fact  that  A is  not  a 
transition  matrix  (indeed,  A is  neither  row  nor  column 
stochastic)  , this  approach  can  be  taken.  Defining  an  n x n 
matrix  H whose  i-th  main  diagonal  element  is  the  rate  cf 
transition  from  state  i (given  the  system  is  in  state  i)  for 
i = 1,2, ...,n  and  whose  nondiagonal  elements  are  all  zeros, 
-1 


then  C = BAH 

is  column  sto 

rewritter  as: 

(3.  13) 

Q = CQ 

where  a = BE. 

The  Markov  ch 

the  existence 

of  a unique  pr 

(3.13)  if  the 

appropriate  ay 

result  can  th 

en  be  translate 

(3.1).  The  reader  is  referred  to  Feller  [32],  Chapter  XIV, 
section  7 on  applications  of  Laplace  transforms.  If  the 
limit  is  taken  in  Feller's  (7.19)  as  the  transformation 
variable  approaches  zero,  the  result  is  the  transpose  cf 
(3.13)  above. 

As  an  alternative  to  tnis  approach  the  results  of 
Perron-Frobenius  theory  will  be  used  here.  At  the  same  time 
the  eigenstr ucture  of  A and  C will  be  investigated  further. 
Our  primary  reference  for  this  section  is  Seneta  [99].  Otaer 
references  are  Varga  [106]  and  Young  [114], 
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3.1.  Perron-Frobenius  Theory 


The  following  theorem  contains  many  of  the  important 
results  cf  the  Perron-Frobenius  theory  of  finite  nonnegative 
matrices.  Its  proof  is  found  in  Seneta  [99]  from  which  its 
contents  were  extracted. 

3^2  Suppose  T is  an  a x n irreducible 
ncnnegative  matrix.  Then  there  exists  an  eigenvalue  r of  T 
such  that: 

(i)  r is  real  and  positive; 

(ii)  there  are  strictly  positive  left  and  rignt 
eigenvectors  cf  T corresponding  tc  r; 

(iii)  the  eigenvectors  cf  T corresponding  to  r are 
unique  up  to  constant  multiples; 

(iv)  r is  a simple  root  of  the  characteristic 
equation  of  T; 

(v)  r > lt|  if  t is  any  other  eigenvalue  of  T; 

(vi)  if  T is  k-cyclic,  then  T has  exactly  k 
eigenvalues  t such  that  |t|  = r and  these  k 

eigenvalues  are  the  roots  of  the  equation 
k k 

t - r =0; 

(vii)  if  T is  not  cyclic,  then  r > |t|  if  t * r 
and  t is  an  eigenvalue  of  T; 

(viii)  if  s is  the  sum  of  the  elements  of  the 
i 

i-th  rcw  of  T and  c is  the  sum  of  the  elements  of 

i 

the  i-th  column  of  T (for  i = 1,2,.. .,n),  then 

(3.14)  min  s < r < max  s and  min  c < c < max  c 
ii  ii  ii  ii 
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The  eigenvalue  r referred  to  in  Theorem  3.6  is 
called  the  Perron- Frobenius  eigenvalue  of  T , and  the  right 
and  left  eigenvectors  corresponging  to  r are  called 
Perron-Frcbenius  eigenvectors. 

A quick  review  of  the  early  part  of  section  4 of  the 
preceding  chapter  reveals  that  A is  a nonnegative  matrix. 

As  indicated  in  Appendix  C,  for  many  models  this  matrix  is 
irreducible  (though  perhaps  cyclic).  Hence,  Theorem  3.6 
applies  in  these  cases.  If  the  Perron-Frobenius  eigenvalue 
of  A were  known  to  have  value  1,  the  three  questions  posed 
at  the  begincing  of  this  section  would  all  be  answered 
positively  by  (i)  , (ii)  and  (iii)  of  Theorem  3.6. 

Consider  now  the  matrix  C defined  above  and 
appearing  in  (3.13).  Since  premultiplication  of  A by  B and 

-1 

postmultiplication  by  3 has  the  effect  of,  respectively, 

multiplying  each  element  in  the  i-th  row  by  the  rate  of 
transition  from  state  i and  dividing  each  element  of  the 
i-th  column  by  this  same  (positive)  number,  C is  also 
irreducible  (and  cyclic).  But  C is  column  stochastic.  So, 
part  (viii)  of  Theorem  3.6  indicates  that  r = 1 is  the 

Perron-Frobenius  eigenvalue  of  C.  By  Theorem  3.4,  A = 

-1 

R CR  has  the  same  eigenvalues  as  C.  The  conclusion  is  that 
the  Perron-Frobenius  eigenvalue  of  A is  r = 1.  Note  further 
that  part  (v)  of  Theorem  3.6  provides  assurance  that  the 
Perron-Frcbenius  eigenvalue  is,  in  some  sense,  dominant 
among  the  eigenvalues  of  A.  This  fact  will  become  important 
in  the  discussion  of  the  solution  methods  in  the  next 
section  First,  however,  it  is  advantageous  to  examine  more 
closely  the  eigenvalues  and  eigenvectors  of  A. 
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3.2 


• Eiqenstr ucture  of  a k-cyclic  Matrix 

Throughout  this  subsection,  A is  a k-cyclic  matrix 
of  order  n in  first  canonical  form.  Hecall  that  if  the 
matrix  of  interest  is  not  in  first  canonical  form,  there  is 
a renumbering  of  the  states  which  will  put  it  into  first 
canonical  form  (Theorem  3.3),  and  doing  so  will  not  affect 
the  eigenvalues  and  will  only  rearrange  the  components  of 
the  eigenvectors  (Theorem  3.4).  As  a matter  of  notaticnal 
convenience  the  following  definition  is  provided: 

Definition  3 . 7 The  rotation  function  e is  defined 
for  any  real  number  s as: 

(3.15)  e (s)  = exp  {-2ni  (s/k)  } 

where  i is  the  imaginary  unit,  /~1 

The  function  e is  called  a rotation  function  because 
multiplication  of  any  complex  number  by  e(s)  induces  a 
rotation  of  that  complex  number  through  an  angle  of  size 
2ns/k  radians  about  the  origin  in  the  complex  plane.  Note 
that  for  any  real  numbers  s and  t and  any  integer  m: 
t 

(i)  [e  (s)  ] = e (st) 

(ii)  e (s)  e (t)  = e (s  + t) 

(iii)  e (mk)  = e (0)  = 1 

Turn  now  to  the  eigenstr ucture  of  A when  A is  in 

first  canonical  form.  From  (3.3),  with  M = I , note  that 

n 

since  each  diagonal  submatrix  of  A is  square,  the  product 

A A is  compatible  as  is  the  product  A A for  i = 2,  3, 

Ik  i i-1 
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...,  k.  For  i = 1,  2,  ...,  k,  define  a matrix  3 = 

i 

A A ...A  A A ...A  . Although  the  following  three 

i i-1  Ik  k-1  i + 1 

theorems  are  stated  and  proved  for  B = B , similar  results 

k 

hold  for  each  E . 

i 


3 . 7 If  t is  an  eigenvalue  of  A and  X is  a 

T 

right  eigenvector  cf  A corresponding  to  t where  X = 


ITT  k 

(X  ^ , X ^ . . . , X^) , then  w = t is  an  eigenvalue  of  3 and  X is 


a right  eigenvector  of  B corresponding  to  w. 


Using  Theorem  3.5  and,  in  particular, 

equation  (3 . 12) : 

k 

BX  = A A ...A  X = tA  A A X = ...  = t X = wX  . 

k kk-1  lk  kk-1  21  k k 


IheO-ESJ!  If  w * 0 is  an  eigenvalue  of  3 and  X 


is  any  right  eigenvector  of  B corresponding  to  w,  and  if  t 


is  any  complex  k-th  root  of  w (i.e.,  any  solution  of  t = 


w) , then  t is  an  eigenvalue  cf  A and  X is  a right 

I T T T 

eigenvector  cf  A corresponding  to  t for  X = (X  ,X  ,...,X  ) 

1 2 k 


where  X = (1/t)A  X and,  for  m = 2,3,...,k-1,  X = 


1 


1 k 


(1/t)  A X 

m m- 1 


By  Theorem  3.5,  all  that  remains  is  to  show 
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that  tX  = A X .To  that  end  use,  respectively,  the 
k k k-1 

definitions  of  X ,X  .....X  and  B and  then  the  fact  that 
k- 1 k-2  1 

X is  a right  eigenvector  of  B corresponding  to  w and  the 


fact  that  t = w: 


AX  * (1/t)A  A X = (1/-C)  A A A X = .. 

k k- 1 k k- 1 k-2  k k- 1 k-2  k-3 

k-1  k— 1 k-1 

= (1/t)  A A ...AX  = (1/t)  BX  = (1/t)  wX 

k k-1  Ik  k k 


= tX 


iilSSISS  iii  If  t is  any  eigenvalue  cf  A and  X is 

1 

any  right  eigenvector  of  A corresponding  to  t,  where  X = 


IT  I 

(X  , X , . . . , X ),  then  for  each  s = 1,2,...,k-1,  t = te  (s)  is 
12k  s 

also  an  eigenvalue  of  A and  Y is  a right  eigenvector  cf  A 

s 

corresponding  to  t where 

s 

T T T T 

Y = (e(-s)X  ,e(-2s)X  ,...,e(-ks)X  ). 
s 1 2 k 


iicof : First  consider  the  case  in  which  t = 0.  Let 

s he  any  element  of  N . Then  t = te (s)  = 0 is  an 

k-1  s 

eigenvalue  cf  A.  Furthermore,  since  X is  an  eigenvector  and 


e(z)  # 0 for  all  real  z,  Y is  nonnull.  A [e(-ks)X  ] = A X 

s 1 k 1 k 

= ( = t [e(-s)X  ].  Similarly,  for  a = 1#2,...rk-1, 
s 1 

A £e{-ms)X  ] = e (-ms)  A X = C = t [ e (-  (m+ 1)  s)  X ].  By 
m+ 1 m a+ 1 m s m+ 1 

Theorem  3.5,  Y is  a right  eigenvector  of  A corresponding 
s 

to  t =0. 
s 

k 

Now  suppose  t * 0 and  let  w = t . Again, 
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let  s be  an  arbitrary  element  of  N . Note  that 

k-1 

k k k 

t = [te(s)  ] = t e (sk)  = w.  By  Theorem  3.7,  * is  an 

s 

eigenvalue  of  B and  X^  is  a right  eigenvector  of  3 


corresponding  to  w.  Since  t is  one  of  the  k-th  roots  of  w, 

s 

t is  an  eigenvalue  of  A by  Theorem  3.8.  Using  Theorem  3.8, 
s 

the  fact  that  Y is  a right  eigenvector  of  A corresponding 
s 

to  t is  verified  as  follows.  First,  (Y  ) = (1/t  )A  X = 

s s 1 s 1 k 

e(-s)  (1/t) A X = e (-s) X . Proceding  by  induction  on  m (from 
Ik  1 

m = 2 to  m = k - 1) , (Y  ) = (1/t  )A  X 

s m s m m- 1 

e(-s)  (1/t)  A [ e (-  (m-  1)  s)  X ] = e (-ms)  X . The  conclusion 
m m - 1 m 

follows  since  e (-ks)  = 1. 


4.  DETERMINATION  GF  DOMINANT  EIGENV AL UE/EI GENVECTOR 

As  noted  at  the  end  of  sunsection  2.3,  the  problem  under 
consideration  is  the  determination  of  a right  eigenvector  of 
the  coefficient  matrix  A corresponding  to  the  eigenvalue  1. 
The  Perrcn-Fiobenius  rheory  discussed  in  that  subsection  not 
only  led  to  a guarantee  that  one  is  an  eigenvalue  of  A and 
that  a ncnnegative  right  eigenvector  of  A corresponding  to  1 
exists;  it  also  guaranteed  that  one  is  a dominant  eigenvalue 
(i.e.,  if  t is  an  eigenvalue  of  A,  then  |t|  < 1)  and  that 
the  right  eigenvector  mentioned  is  positive  and  unique  up  to 
scalar  multiplication.  In  addition,  the  exact  form  of  all 
other  eigenvalues  of  A having  modulus  one  and  of  the  right 
eigenvectors  corresponding  to  these  other  dominant 
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eigenvalues  were  determined  (see  Theorem  3.9). 


This  section  discusses  some  simple  iterative  methods  of 
determining  the  sought-after  right  eigenvector.  Since  many 
of  the  central-server  models  of  interest  are  cyclic,  the 
effect  of  applying  these  methods  to  a k-cyclic  matrix  are 
considered.  For  a more  extensive  account  of  the  acyclic 
case,  the  reader  is  referred  to  Householder  [53].  The 
methods  discussed  here  closely  parallel  the  stationary 
iterative  methods  for  solution  of  a system  of 
(ncnhomogeneous)  linear  equation  discussed  by  Young  [114]  in 
his  third  chapter. 

Once  again,  even  though  the  discussion  is  confined  to 
right  eigenvectors,  a parallel  development  is  possible  for 
left  eigenvectors. 

4.1.  The  Power  Method 


The  well-known  power  method  ,is  a favorite  tool  for 
determining  the  steady-stare  probability  for  finite  ergodic 
Markov  chains  in  beginning  stochastic  modelling  courses.  It 
will  presently  be  shown  that  this  method  runs  into 
difficulty  whenever  the  matrix  under  consideration  is 
cyclic.  Nonetheless,  it  is  an  important  method  since  eacn 
of  the  ether  methods  to  be  discussed  is  equivalent  to  the 
power  method  applied  to  a matrix  which  is  derived  from  tne 
matrix  of  interest. 

Let  A be  a matrix  of  order  n.  For  the  present, 
assume  nc  further  knowledge  concerning  A or  its 
eigenstr ucture.  The  power  method  is  an  iterative  technique 

(0) 

which  generates,  for  some  starting  vector  X , a sequence 


(1)  (2)  (3) 

of  vectors  X , X , X , ...  where  for  each  i > 1, 


(3.  16) 


(i)  -1  f i- 1 ) 

X = b AX 
i 


where  b is  a normalizing  factor.  Under  appropriate 
i 

conditions,  the  normalizing  factors  b will  converge  to  a 

i 

(i) 

dominant  eigenvalue  of  A and  the  vectors  X will  converge 

tc  a right  eigenvector  cf  A corresponding  to  this  dominant 

eigenvalue.  Note  that  (3. 16)  can  be  written  as  a sequence 
of  n equations  as  follows:  Por  j = 1,2,...,n, 


(3. 17) 


(i)  -1  “ U-1) 

x = b 2 a x 
j i jk  k 

k=1 


Keeping  this  formulation  in  mind,  computational 
implementation  of  the  power  method  follows: 


(i)  Choose  a 

(row)  vector 
i = 1. 

(ii)  Calculat 

this  is  accom 
j = 1,2,...,n 

(i) 

(3.18)  Y 

3 


The  Power  Method 
(0) 

starting  vector  X , a 
Z,  and  a convergence  cri 

(i)  (i-1) 

e Y = AX  . Compu 

plished  in  the  following 

r 


n 

2 

k= 


(i-1) 

x 

k 


normalizing 
terion.  Set 

tationally , 
manner:  For 
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(i)  (i)  -1  (i) 

(ili)  Let  b = ZY  and  X = b Y 
i i 

(iv)  If  i = 1,  or  if  i > 1 and  the  convergence 

criteri.cn  is  not  satisfied,  increase  i by  1 and  go 

to  (ii) . Otherwise,  the  method  has  converged;  b 

i 

, • (i)  . 

is  a dcminant  eigenvalue  and  X is  a ngnt 


eigenvector  corresponding  to  b . STOP. 

i 


Typical  normalizations  used  set  the  sum  of  the 

(i) 

components  of  X agual  to  ~ne  (all  components  of  2 are 

(i) 

ones)  or  set  the  first  component  of  X egual  to  one  (the 


first  component  of  Z is  one,  all  others  are  zero;  b = 

i 

(i) 

y ).  Typical  convergence  criteria  include;  the  absolute 

difference  between  b and  b is  small,  the  percentage 

i i-1 

difference  between  b and  b is  small,  the  largest 

i i-1 


absolute  difference  between  corresponding  components  of  X 


(i) 


(i-1) 

and  X is  small,  and  the  percentage  change  in  the  sum  of 

the  absolute  differences  between  corresponding  components  of 

(i)  , (i-1)  . 

X and  X is  small.  ("Small”  means  "less  than  e"  for 

seme  e > C.) 


Turn  now  to  the  convergence  properties  of  the  power 

method.  Suppose  that  there  are  m distinct  eigenvalues  of  A, 

namely  t , t , ...,  t , numbered  such  that 
1 2 m 
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\ 


(3.19) 


It  | > |t  | > ...  > |t  | 
12  m 


Note  that  all  cf  tie  right  eigenvectors  of  A and  all  of  the 
vectors  generated  in  the  power  method  are  elements  of  the 

n 

space  of  n-dimensional  complex  vectors,  hereafter  called  C . 

n 

It  can  be  shown  that  there  is  a basis  of  C , B = (H  , H , 

0 1 2 


. ..,  H },  such  that  each  H is  associated  with  exactly  one 
n i 


eigenvalue  cf  A,  and  if  B is  the  subset  of  B associated 

j 0 


with  eigenvalue  t for  some  j = 1,2,...,m,  then  each  right 

j 


eigenvector  cf  A corresponding  to  t is  a linear  combination 

j 

of  the  elements  of  B . (For  those  familiar  with  this 

j 

subject  area,  the  elements  of  B are  the  columns  of  a matrix 

0 

- 1 

H such  that  H AH  is  in  Jordan  canonical  form.  Others  are 


referred  to  Householder  [53].)  Consider  a special  case  in 


which  each  element  of  B is  an  eigenvector  of  A.  Wore 

0 


general  situations  exist.  However,  their  consideration 


leads  to  the  same  conclusions,  complicates  the  analysis,  and 
adds  very  little  in  the  way  of  insight  into  the  subject 
matter  of  this  thesis. 


n 

Since  B is  a basis  for  C and  any  starting  vector 
0 

(0)  . . n (0) 

X is  m C , X can  be  uniguely  expressed  as  a linear 


combination  of  the  elements  of  B . Since  each  element  of  3 

0 0 
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is  an  eigenvector  of  A,  property  (iii)  of  eigenvectors 
imp lies: 


(0) 

(3.20)  X = l c V 

H 3 3 


where  V is  a right  eigenvector  cf  A corresponding  to  t . 

3 ' 3 

Note  that  V is  a linear  combination  of  the  elements  of  B 
j 3 

for  each  j = 1,2,...,m.  Suppose  now  that  a normalizing 
vector  Z has  teen  chosen.  For  each  s = 1,2,3,..., 


s m 

(s)  -1  s 

(3.21)  X = (TT  t.)  2 C t .v . 

.1  .,333 

i=1  ]=1 


where  b is  as  in  step  (iii)  of  the  power  method, 
i 


Consider  the  case  in  which  |t  | > |t  |.  Then,  the 

1 2 

goal  in  applying  the  power  method  is  to  find  the  value  of  t 

(0) 

and  a right  eigenvalue  cf  A corresponding  to  t^.  If  X is 

net  orthogonal  to  all  of  the  vectors  in  B , then  c * 0 and 

1 1 

the  power  method  is  guaranteed  to  converge  to  t ^ and  seme 
multiple  cf  the  right  eigenvector  V^.  To  see  how  this 
happens  in  the  case  under  consideration,  rewrite  (3.21)  as 


175 


(3.22) 


(s)  s 

x = CTT  (t  /b.j  ] 2 (t  ,/t  ) c .v  . 

. 1 i , 3 i 3 3 

i=1  3=1 


= Ct/dT  bi,](civi  ♦ (t/VV, 

i=  1 


+ ...  + (t  /t  ) c v } 
ml  mm 


Since  | t | > | t | for  j = 2,3,...,m,  (t  /t  ) goes  to  zero 

1 j j 1 

as  s increases.  Hence,  the  sum  approaches  c^V^.  To  S6e 

what  happens  to  the  factor  preceding  the  sum  on  the  right 
hand  side  cf  (3.22),  consider  a value  of  s so  large  that  the 
sum  can  te  replaced  by  c^V^.  Then,  replacing  the  factor 

(s) 

preceding  the  sum  by  w , (3.22)  shews  that  X is 

s 

approximately  egual  to  w c V . Following  the  steps  of  the 

s 1 1 

(s+1) 

power  method,  Y is  approximately  egual  to  w c AV  = 

s 1 1 


w c t V and  b is  aopcoximat ely  equal  to  w c t SV  = t 

Sill  3+1  S 1 1 1 1 


(S) 

since  X had  already  been  normalized.  Thus,  w 


s+  1 


w (t  /a  ) = w approximately.  So,  b converges  to  t and 
s 1 s+1  s s 1 

(s) 

X converges  to  a multiple  of  V^.  Also  note  from  (3.19) 


and  (3.22)  that  jt^/t^J  is  a measure  of  the  rate  at  which 
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this  convergence  takes  place.  That  is,  the  smaller  this 
quantity  is,  the  mere  rapidly  convergence  takes  place. 


(0) 

If  X is  orthogonal  to  all  of  the  vectors  in  3 


1 


(i.e.,  c =0),  then  it  is  seen  from  (3.21)  that  the  power 
method  cannct  converge  to  t and  a corresponding  right 


eigenvector,  though  it  might  converge  to  one  or  the  other 
eigenvalue/eigenvector  pairs. 


New  consider  the  case  in  which  |t  | = |t  | > jt  | 

1 k k + 1 

for  some  1 < k < m (where  t = 0 if  k = m)  . This  is  the 

m + 1 

case  if  A is  k-cyclic.  Then,  for  large  s,  terms  involving 

t , t , ...»  t in  (3.22)  can  be  ignored.  The 
k*  1 k+2  i 

(approximate)  result  is  (3.22)  with  the  upper  limit  on  the 

(s) 

sum  changed  from  m to  k.  So,  for  each  s,  X is  a linear 

combination  cf  the  right  eigenvectors  V , V , ...»  V where 

1 2 x 

the  coefficients  are  dependent  upon  s.  In  the  case  that  A 
is  k-cyclic.  Theorem  3.9  gives  some  insight  into  the  nature 
of  this  dependence.  In  particular,  t /t  = e (j)  for  j = 

j 1 

1,2,. ..,k.  Sc,  we  get  (approximately): 
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(S) 

(3.23)  X = w 5 e(sj)c  V 

Vi  3 3 


(s) 

From  this  it  is  easy  to  see  that  (for  s large)  X is 

(s  + k) 


approximately  the  same  as  X 


but  probably  different  from 


(s+1)  (s  + 2)  (s*k- 1) 

X , X , ...  , X . Even  w does  not  converge, 

s 

(S) 

though  |w  | does.  Note  that  even  though  the  sequence  X , 

c 

(s  + k)  (s+2k) 


, X 


, ...  converges,  the  limit  is  not  an 


eigenvector  cf  A,  in  general. 


Example  3 . 1 

Consider  applying  the  power  method  to  the  following 
ncnnegative,  2-cyclic,  irreducible  matrix  A: 


A 


r0  1/2, 
U 0 J 


The 

following  table  lists  the 

first 

four 

b ' s and 
i 

The 

normalx  zing 

vector  is  Z = 

(1.1) 

; the 

starting 

given  in  the  table. 

i 

0 1 

2 

3 

4 

b 

i 

7/2 

2/7 

7/2 

2/7 

(i) 

r 2,  r~  1/7, 

r 2, 

r~  1 /7, 

r 

X 

t-1-»  <■  8/7J 

C-1J 

•-  8/7J 

l-ij 
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By  Theorems  3.6  and  3.9,  A has  two  distinct  eigenvalues; 
bcth  are  real  and  one  is  the  negative  of  the  other.  The 

positive  eigenvalue  is  between  1/2  and  2.  Noticing  that 

•1  i-O  It  rl  Ot 

SAB  = where  R = | , it  can  be  concluded  from 

ll  0-J  to  2-1 

Theorem  3.4,  part  (viii)  of  Theorem  3.6  and  Theorem  3.S  that 

the  eigenvalues  of  A are  1 and  -1.  It  is  important  to 
notice  that  the  reason  the  power  method  does  not  converge  is 
that  A is  cyclic. 

Another  problem  with  tne  power  method  involves  the 
choice  cf  Z.  For  example,  if  the  sum  of  the  components  of 

V is  zerc,  then  Z = (1,1,.. . , 1)  will  lead  to  difficulties. 
1 

Since  V is  unknown  prior  zo  apolication  of  the  power 
1 

method,  there  is  often  no  assurance  that  any  particular 

choice  cf  Z will  avoid  this  complication.  However,  if  A is 
ncrnegative  and  irreducible.  Theorem  3.6  parts  (ii)  and 
(iii)  guarantee  that  has  no  zero  components  and  that  all 

components  of  have  the  same  sign.  Thus,  both  normalizing 

procedures  mentioned  earlier  in  this  subsection  are 
guaranteed  to  avoid  such  difficulties. 

These  same  parts  of  Theorem  3.6  can  also  be  used  to 
help  avoid  the  problem  of  choosing  a starting  vector  which 
is  orthogonal  to  V^.  Since  all  of  the  components  of  V have 

the  same  sign,  any  vector  orthogonal  to  must  have  seme 

components  with  positive  real  part  and  some  with  negative 

(0) 

real  part.  So  if  X n as  all  nonnegative  (or  all 
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nonpositive)  components,  X 


cannot  be  orthogonal  to  V . 


(0) 


is  a final  comment  concerning  the  power  method  note 
that  the  purpose  of  the  normalization  procedure  is  tc  insure 
that  the  method  converges  to  a nontrivial  value.  Without 
the  normalization  procedure  (3.22)  becomes: 

m 

(s)  s s 

(3.24)  X = t 2 (-  ./ 1 ) c .V. 

1 . , 3 1 3 3 

3 = 1 

The  sum  cn  the  right  hand  side  of  (3.24)  is  the  same  as  the 
sum  on  the  right  hand  side  of  (3.22)  and  approaches  the  same 

s 

limit  as  s becomes  large.  However,  t approaches  zero  if 


1 1 ^ | < 1 or  infinity  if  |t^|  > 1.  If  |t^| 


= 1 but  t^  * 1, 


then  t = exp{yi}  for  some  real  number  y which  is  net  an 


(s  + 1) 

integer  multiple  of  2n.  In  this  case  for  large  s,  X 


(s) 

exP  {y±J x approximately.  That  is,  the  magnitude  of  the 


vectors  generated  by  the  power  method  will  converge,  but 

there  will  be  an  angular  displacement  of  y radians  between 
successive  vectors  for  large  s.  As  indicated  at  the  end  of 

subsection  3.1,  t = 1 for  the  cases  of  interest  in  this 

thesis.  In  such  cases  normalization  is  not  reguired  fer 

convergence  cf  the  power  method.  On  the  other  hand,  if  the 
convergence  criterion  used  in  step  (iv)  of  the  power  method 
is  based  upon  an  absolute  difference  rather  than  a percent 
difference,  the  normalization  procedure  (or  lack  thereof) 
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will  affect  the  number  of  iterations  necessary  to  attain 
convergence  and  the  degree  to  which  the  convergence 
criterion  is  satisfied  by  the  final  answer. 


For  example,  suppose  that  the  convergence  criterion 
(£)  (s-1)  -4 

is:  max  |x  -x  | < 1 0 Suppose  that  after  k steps 

i i i 

(k)  (k-1 ) -4 

it  is  found  that  lax  |x  -x  | = 0.8  x 10  . Then,  the 

i i i 

(JO 

method  has  converged  and  P = X /(ZX  ) is  the  desired 


solution  to  the  system  (3.1),  (3.3),  (3.4),  where  Z = 


(k-1)  (k-1) 

(1,1,..  .,1)  . Eut,  rf  Q = X /(ZX  ) , then  P = AC 


-4  (k) 

(approximately)  and  max  |p  -g  | = (0.8x10  ) / (ZX  ).  dote 

i i i 

(it)  -4 

that  if  ZX  < 0.8,  max  |p  -g  | > 10  ; i.e.,  more 

i i i 


iterations  should  have  been  performed.  By  way  of  contrast. 


(k)  -5 

if  ZX  > 8.0,  max  j p -a  | < 10  and  fewer  iterations  were 

i i “i 

prcbably  reguired.  New  if  c is  chosen  so  that  ZV  = 1, 

j D 

(k)  T (C)  T 

then  ZX  =c  =VX  /(V  V ) which  is  highly  dependent 
1111 


upon  the  relationship  between  the  starting  vector  and  the 


desired  solution  vector  P = V (see  equations  (3.24)  and 


(3.20)).  Since  V is  unknown,  this  relationship  is  also 


unknown . 
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4.2.  The  Rela xed  Power  Method 


The  power  method  is  homologous  to  the  Jacobi  method 
for  iterative  solution  of  a system  of  linear  eguations.  The 
method  discussed  in  this  subsection  is  homologous  to  the 
relaxed  Jacobi  method.  Young  [114],  Chapter  3,  is  suggested 
as  background  reading  for  the  subject  of  this  and  the 
following  two  subsections. 

The  relaxed  power  method  yields  at  each  iteration  a 
weighted  sum,  or  average,  of  the  vector  calculated  in  the 
power  method  and  the  preceding  vector  from  which  it  was 
calculated.  To  specify  this  method  replace  step  (ii)  cf  the 
power  method  by: 

. , U)  (i-1)  „ (i-1) 

(u)  Caxculate  Y = w4X  ♦ (1-w)  X 

Computationally,  this  is  accomplished  in  the 
following  manner:  For  j = 1,2,. ..,n. 


(3.25) 


(i) 


y . 

3 


(i-1)  (i-1) 

= w > a x + (1-w)  x 

. , 3k  k j 

K=  1 


Usually  the  real  number  w is  chosen  at  the  start  (i.e.,  step 
(i) ) , though  it  could  conceivably  be  changed  at  each 
iteration. 


The  conceptual  difference  between  the  power  method 
and  the  relaxed  power  method  is  best  illustrated  in  terms  of 
an  analogous  situation.  Consider  attempting  to  determine  a 
solution  for  an  equation  f (x)  = 0.  Using  some  iterative 
method  (e.g.,  Newton's  method),  a sequence  of  numbers 


{X  ,x  ,x  ,.  . .} 

C 1 2 


is  generated  which  converges  to  a number  x 
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such  that  f(x)  = 0.  This  is  done  by  choosing  a starting 

value  x and,  for  i = 1,2,3,...,  letting  x = g (x  ) where 
0 i i- 1 

g is  a functicn  somehow  related  to  f.  Now  consider  an 

attempt  tc  accelerate  the  convergence  by  developing  a 

sequence  {y  ,y  ,y  ,...}  where  y = x and,  for  j > 1,  y = 

0 1 2 0 0 j 

wg (y  ) ♦ (1-w)y  . How  could  w be  chosen  so  that  the 

j-1  j-1 

y 's  converge  to  x more  rapidly  than  the  x 's?  If  the 
i i 

function  g is  known  to  consistently  overshoot  the  mark 

(i.e.,  if  x is  known  to  always  lie  between  a (y)  and  y)  , then 
choosing  w between  zero  and  one  will  always  put  y between 

j 

g(y  ) and  y and  (hopefully)  therefore  closer  to  x.  On 
j-1  j-1 

the  other  hand,  if  g is  known  to  consistently  undershoot  the 
mark,  then  a choice  of  w > 1 will  push  y beyond  g (y  ) and 

j j-  1 

(again,  hopefully)  closer  to  x. 

Similarly,  the  relaxed  Jacobi  and  relaxed  power 

(i) 

methods  seek  tc  choose  w so  that  the  resulting  X at  each 

iteration  is  closer  to  the  vector  sought  than  it  would  be  if 
w = 1 (i.e.,  no  relaxation).  The  method  is  said  to  be  an 

uncerrelaxed  method  if  0 < w < 1 and  an  overrelaxed  method 
if  w > 1.  The  question  of  whether  to  underrelax  or 
cverrelax  in  a particular  situation  seems  to  be  related  to 
the  values  of  the  eigenvalues  of  the  matrix  in  question. 
Since  these  are  generally  not  known,  the  question  of  what 
value  to  give  w is  usually  a difficult  one.  Wallace  and 
Rosenberg  [1C8]  use  a relaxed  power  method  in  their 
recursive  queue  analyser  program.  They  suggest  w = 1 . 3 as  a 
gocd  choice  in  many  of  the  problems  they  have  solved.  The 
choice  of  w for  k-cyclic  matrices  is  investigated  in  the 
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remainder  of  this  subsection. 


Notice  from  the  revised  step  (ii)  above  that  the 
relaxed  power  method  is  the  power  method  applied  to  the 

matrix  B = wA  ♦ (1-w)I.  If  A is  a nonnegative,  k-cyclic 

w 

(irreducible)  matrix,  then  B is  irreducible  (all  nonzero 

w 

positions  in  A are  still  nonzero  in  B ) , is  acyclic  if  w * 

w 

1,  and  is  ncnnegative  if  0 < w < 1 . So  B can  be  viewed  in 

w 

terms  of  Eer r cn-Frobenius  theory  if  0 < w < 1.  However, 

mere  information  can  be  obtained  by  directly  examining  the 

relationship  between  the  eigenstructur es  of  A and  B . 

w 

Let  t be  any  eigenvalue  of  A and  let  V be  any 

3 j 

right  eigenvector  of  A corresponding  to  t . Then,  B V = 

j w j 

[wA  + ( 1 — w } I ]V  = WAV  + (l-w)IV  = wt  V + ( 1- w)  V = 

3 3 j j j 3 

[ wt  + ( 1 — w ) ] V . That  is,  V is  a right  eigenvector  of  B 

j j j w 

corresponding  to  eigenvalue  [wt  + ( 1 — w)  ].  In  essence,  the 

j 

relaxaticr  leaves  the  eigenvectors  untouched  and  replaces 

each  eigenvalue  t by  a weighted  sum  of  t and  one,  g (t)  = 
wt  ♦ (1-w).  Note  that  t = 1 is  the  only  fixed  point  for  the 
transf or maticn  g.  If  0 < w < 1,  g (t)  is  closer  to  one  than 
t is.  If  w > 1,  g (t)  is  further  away.  (If  w < 0,  g(t)  is 
on  the  other  side  of  one.)  This  transformation  of  t by  g is 
performed  along  a straight  line  in  the  complex  plane  passing 
through  t anc  cne. 

New  consider  the  case  in  which  the  coefficient 
matrix  A is  k-cyclic.  Let  t be  any  eigenvalue  of  A such 
that  |t|  = 1 but  t # 1.  (Note  that  Theorem  3.6  guarantees 
the  existence  cf  k - 1 such  eigenvalues.)  Since  the 


straight  lint  in  the  complex  plane  passing  through  t and  one 
intersects  the  unit  circle  only  at  t and  1,  g (t)  will  te 
outside  the  unit  circle  if  w > 1 (or  w < 0) . That  is,  if  w 
> 1,  one  is  no  longer  a dominant  eigenvalue  and  the  power 
method  will  net  converge  to  the  desired  eigenvector.  Cn  the 
other  hand,  if  0 < w < 1,  all  of  the  eigenvalues  on  the  unit 
circle  (except  one)  are  drawn  into  the  unit  circle  as  they 
are  drawn  closer  tc  one,  and  one  is  the  unique  dominant 

eigenvector  of  B . 

w 

New  consider  more  specifically  the  effects  of  this 

transformation  on  the  eigenvalues  of  A.  Suppose  w is  any 

real  numfcer  between  zero  and  one  (noninclusi ve)  and  let  t = 

(x,y)  be  any  eigenvalue  of  A other  than  (1,0).  (The  ordered 

pair  notation  for  complex  numbers  is  used  here.)  The 

eigenvalue  cf  B corresponding  to  t is  g(t)  = wt  ♦ (1-w)  = 

w 

(wx*1-w,wy).  The  question  is  whether  g ( t ) is  closer  to  the 
origin  or  further  from  the  origin  than  t.  Sc,  note  that: 


lg  (t)  i < |ti 

2 2 2 2 

2 

iff 

(wx+1-w)  + w y < x 

+ y 

2 2 2 2 

2 

iff 

(1-w)y  ♦ ( 1- w ) x 

2w  (1-w)  x - (1-w)  > 0 

iff 

2 2 

y + x - 2[  w/(1>«)  Jx 

> (1-w)/  (1  + w) 

2 2 

2 

iff 

y ♦ [ x - w/  (1*w)  ] > 

1/(1  + w) 

From  this 

it  car  oe  seen  that  t 

he  transformation  will 

closer  tc  zero  only  those  eigenvalues  outside  the  circle  in 
the  complex  plane  with  center  at  (w/(1+w),0)  and  radius 
1/(1+w).  These  eigenvalues  inside  this  circle  will  be  drawn 
further  frem  the  origin.  As  depicted  in  Figure  3.",  this 
circle  is  inscribed  witnin  the  unit  circle,  touching  it  cnly 
at  (1,0)  . Since  0 < w < 1,  1/2  < 1/(1  + w)  < 1.  Hence,  the 
origin  is  always  within  the  circle  and  the  circle  contains 
at  least  cne-fcurth  the  area  of  the  unit  circle.  This  type 
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Figure  3.1--Effects  of  the  Relaxed  Power 
Method  on  the  Eigenvalues  of 
Magnitude  Less  Than  One 


of  information  is  sufficient  to  determine  the  best  the  case, 
value  for  w (in  terms  of  the  convergence  properties  of  the 

power  method  on  3 ) if  all  of  the  eigenvalues  of  A are 

w 

known.  Unfortunately,  this  is  seldom  Precise  theorems  on 

the  convergence  properties  of  the  relaxed  power  method  are 
very  difficult  to  determine. 

One  exception  is  the  case  in  which  A is  a k-cyclic 
matrix  and  one  is  a dominant  eigenvalue  of  A.  Since  k of 
the  eigenvalues  of  A are  known  (they  are  the  k-th  roots  of 

unity) , the  eigenvalues  of  B corresponding  to  these  can  be 

w 

used  to  provide  a lower  bound  for  the  measure  of  convergence 

of  the  power  method,  | t /t  | . In  Figure  3.2,  point  d is  at 

the  eigenvalue  of  A on  the  unit  circle  closest  to  point  a,  c 

is  at  the  eigenvalue  cf  5 corresponding  to  the  eigenvalue 

w 

of  A at  a,  and  b is  at  the  midpoint  of  the  line  segment  ad. 

In  radians  tte  angle  aod  is  2n/k,  angles  aob  and  bod  are 
each  half  of  this  or  n/k,  angle  cod  is  w(2n/k),  and  angle 
aoc  is  ( 1-w)  (2n/k)  . Line  segments  ao  and  od  each  have 
length  one,  and  line  segments  ad  and  ob  are  perpendicular. 
From  this  it  can  be  concluded  that  line  segment  ob  has 
length  ccs  (n/k)  and  line  segment  oc  has  length: 

h = [cos  (n/k)  ]sec[n/k  - (2n/k) min  (w, 1-w)  ] 

Since  point  c is  at  an  eigenvalue  of  B , | t /t  | = | t | > 

w 2 1 2 

n.  Choosing  w to  minimize  h may  relax  this  lower  bound 

without  improving  the  convergence  properties.  Note  that 
this  bound  is  useless. if  k = 2. 
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Figure  3.2--Effects  of  the  Relaxed  Power  Method 
on  an  Eigenvalue  of  Magnitude  One 


4.3.  The  Gauss- Seidel  Method 

Returning  to  the  steps  of  the  power  method  as  set 
forth  in  subsection  4.1,  note  that  at  each  iteration  all  of 
the  components  of  the  old  vector  are  used  to  determine  each 
component  of  the  new  vector.  Computationally  this  means 
that  the  cld  vector  must  be  retained  in  storage  at  least 
until  the  new  vector  has  been  completely  determined. 

However,  note  that  at  each  iteration,  step  (ii)  is 
accomplished  by,  in  sequence,  applying  (3.18)  with  j = 1, 
then  with  j = 2,  then  with  j = 3,  and  so  forth.  In  other 

(i) 

words,  for  j > 1,  y is  Inawn  for  k.  = 1 , 2,  ...,  j.  - 1 and 

k 

(i- 1)  (i) 

could  be  used  in  the  place  of  x in  calculating  y 

k j 

This  is,  in  effect,  done  if  (3.18)  is  replaced  by 


j* 1 . n 

, _ (i)  ^ (i)  _ (i-1) 

(3.26)  y = ? a y + ? a x 

j ~ jk  k . . jk  k 

k=1  k=j 


This  observation  is  the  basis  of  the  Gauss-Seidel  method. 

Consider  the  matrix  manipulations  necessary  to 
replace  (3.18)  by  (3.26).  The  matrix  A can  be  uniquely 
written  as  A = 0 + L where  U has  all  zeros  below  the  main 
diagonal  and  L has  all  zeros  on  and  above  the  main  diagonal. 
The  collection  of  equations  specified  by  (3.26)  for  j - 1, 

2,  ...,  n is  represented  in  matrix  notation  as 


(3.27) 


(i)  (i)  (i“1) 

Y = LY  * UX 
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Since  L has  all  zeros  on  and  above  the  main  diagonal,  I • L 

(i) 

is  nonsingular.  Collecting  the  terms  involving  Y and 

-1 

multiplying  through  by  (I  - L)  (3.27)  becomes 

(i)  -1  (i- 1 ) 

(3.28)  Y = (I-L)  UX 

Cef inition  3^8  Let  A be  a square  matrix.  Then  the 

-1 

matrix  G — (I-L)  U is  the  G auss-Seidel  iterative  matrix  of 

A where  L and  U are  the  unique  matrices  such  that  L has  all 
zeros  on  and  above  the  main  diagonal,  U has  all  zeros  below 
the  main  diagonal,  and  A = L ♦ U. 

Ihe  Gauss-Seidel  method  is  the  power  method  applied 
to  the  Gauss-Seidel  iterative  matrix  of  A.  To  specify  this 
method  replace  step  (ii)  of  the  power  method  by: 

(i)  (i-  1 ) 

(n)  Calculate  Y = GX  where  G is  the 

Gauss-Seidel  iterative  matrix  of  A. 

Computationally,  this  is  accomplished  by 
successively  applying  (3.18)  with  j = 1 .and  (3.26) 
with  j = 2,  3,  ...»  n. 


Very  little  is  xnown  about  the  relationship  between 
the  eigenstr uctures  of  A and  its  Gauss-Seidel  iterative 
matrix,  G.  It  can  be  shown  that  G is  nonnegative  if  A is 
ncnnegative.  Seneta  [99]  shows  that  if  A is  nonnegative. 


the  Perrcn-Frobeni us  eigenvalues  r (of  A)  and  r (of  G) 

A G 


have  one  of  the  following  relationships: 

fi)  0 < r < r < 1;  or 
G A 

(ii)  r = 1 = r ; or 
A G 
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(iii)  1 


< r < r . 

A G 

In  the  cases  cf  interest  in  this  thesis,  of  course,  (ii) 
applies.  In  fact,  there  is  some  hope  that  the  Gauss-Seidel 
method  will  converge  to  the  desired  eigenvector,  as  can  be 
seen  in  the  following  theorem. 

Theorem  3 . 1 C Let  A = U ♦ L be  any  square  matrix  and 

- 1 

let  G = (I-I)  U be  the  Gauss-Seidel  iterative  matrix  cf  A. 
Then  one  is  an  eigenvalue  of  A and  X is  a right  eigenvector 
cf  A correspcnding  to  one  iff  one  is  an  eigenvalue  of  G and 
X is  a right  eigenvector  of  G corresponding  to  one. 

Proof:  X = AX  = (U  + L)  X 

iff  (I-L) X = UX 
-1 

iff  X = (I-L)  UX  = GX. 

Add  to  theorem  3.10  the  result,  extracted  from 
Seneta,  that  cne  is  the  Perr on-Frobenius  eigenvalue  cf  G in 
the  cases  cf  interest  in  this  thesis,  and  indeed  there  is 
seme  hope  that  the  Gauss-Seidel  method  will  converge  tc  the 
desired  eigenvector  of  A.  One  primary  problem  still 
remains:  G may  be  cyclic.  That  is,  the  Gauss-Seidel  method 

may  not  converge.  The  following  theorem,  which  is  perhaps 
the  most  striking  result  known  about  tne  relationship 
between  the  eigenstructures  of  A and  G,  considers  this 
problem  in  the  case  that  A is  k-cyclic. 

Theorem  Let  A be  a k-cyclic  irreducible  matrix 

of  order  n ic  first  canonical  form  (as  specified  in  (3.3) 

with  h = I) . Let  G be  the  Gauss-Seidel  iterative  matrix  of 

A.  Then,  if  t , t ,...,  t are  the  distinct  eigenvalues  of 
1 2 m 

A numbered  sc  that  (3.19)  is  satisfied,  and  if 
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r 


k 

specified  in  (ii)  , t is  -an 


G iff  t is  an  eigenvalue  of  A. 
an  eigenvalue  of  G (even  if  it  is 
not  an  eigenvalue  of  A)  , and  every  nonnull  vector 
T IT  T 

X,  such  that  X = (X  ,X  , . . . ,'L  ) where  X = 0 , is 

12  k k 


an  eigenvector  of  G corresponding  to  zero. 


(iii)  The  Gauss-Seidel  method  will  converge 
(barring  an  unfortunate  choice  of  starting  vector) 

k 

to  an  eigenvalue  w = t and  an  eigenvector  X,  such 


T T T T 

that  X = (X^,X  # ... »X^) , where  X^  is  an 


eigenvector  of  3 = A A ...A  corresponding  to  w 

k k-1  1 


(see  Theorem  3.7)  and  for  i = 1,2,...,k-1,  X = 

i 


(1/w)  A A ...AX. 
i i-1  Ik 


Proof:  First  determine  the  form  of  G in  terms  of 

the  submatrices  of  A. 


(i)  Except  as 

eigenvalue  cf 

(ii)  Zero  is 
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J 


11  IT  T 

Let  X = X = (X^  ,X  , . . . ,X^)  be  any  vector  of  length 
n.  Then, 


(3.29) 


GX  = 


r AX 

1 

k 

A A 

X 

2 1 

k 

AAA 

X 

3 2 

1 k 

A A 

X 

•-  k k- 

' kJ 

which  is  independent  of  X , X , X . Note  from 

12  k- 1 

(3.29)  that  w is  an  eigenvalue  of  G and  X # C is  a right 

eigenvector  cf  G corresponding  to  w iff 

wX  = A A ...  A X 
i i i-1  Ik 

for  i = 1,2,.  ..k.  In  particular,  wX  = A A ...A  X = 3X  , 

k k k-1  Ik  k 

Part  (i)  new  fellows  from  Theorems  3.7  and  3.3.  Part  (ii) 

follows  immediately  since  X =0  implies  GX  = 0 = OX.  By 

k 

k k k k 

Theorem  3.8,  t = t = ...  = t . Since  |t  | > |t  |,  t 
12  k k k+ 1 1 

is  the  unigue  dominant  eigenvalue  of  B.  This  is  sufficient 

to  prove  (iii)  . 
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The  proof  cf  Theorem  3.11  relies  heavily  upon  the 
hypothesis  that  A is  in  first  canonical  form.  It  is  natural 
to  ask  if  the  results  (particularly  part  (i) ) are 
independent  cf  this  assumption.  For  k > 2 the  answer  is 
negative.  In  fact,  a proof  similar  to  that  of  Theorem  3.11 
reveals  that  G is  cyclic  of  order  k-1  (though  not 
irreducible)  if  A is  in  second  canonical  form.  The 
following  example  illustrates  that  point. 

Example  3.2 

r 0 1 0-| 

Let  A = JO  0 II.  Then,  A is  3-cyclic  and  irreducible. 
*■10  0-* 

f0  1 0t  c 1 0 0-j  _ 1 pi  0 C-j 

Also  U = JO  C 1|,,  I - L = | 0 1 0|,  (I  - L)  = |0  1 0|, 

*•0  0 0-«  *--i  o 1J  *-10  1-i 

r C 1 0^ 

and  so  G = jC  0 1 . G is  seen  to  have  period  2. 
iC  1 0-* 

In  the  case  that  k = 2,  the  first  and  second 
cancnical  terms  coincide.  Hence,  an  example  similar  to 
Example  3.2  hill  net  yield  a negative  result.  For  this 
case: 


Conjecture:  If  A is  a 2-cyclic,  irreducible  matrix, 

and  if  G is  the  Gauss-Seidel  iterative  matrix  of  A,  then  t 

2 

is  an  eigenvalue  of  A iff  t is  an  eigenvalue  of  G,  except 

that  zero  is  an  eigenvalue  of  G even  if  it  is  not  an 
eigenvalue  cf  A. 

If  A is  in  first  cancnical  form,  this  result  is  true 
by  Theorem  3.11.  The  following  theorem  lends  plausibility 
to  the  conjecture  by  showing  that  it  is  true  if  A is  in 
third  cancnical  form. 
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Theorem  3._J1 2 Let  A oe  a 2-cyclic  matrix  in  third 
canonical  form  as  specified  by  (3.9),  and  let  G be  the 
Gauss-Seidel  iterative  matrix  of  A.  Then 

(i)  zerc  is  an  eigenvalue  of  G and  any  nontrivial 

T T 

vectcr  5 such  that  Y = (Y^ , C,  0,  . . . , C)  is  an 


eigenvector  cf  G corresponding  to  zero;  and 


(ii)  t * 0 is  an  eigenvalue  of  A and  X is  an 


eigenvector  of  A corresponding  to  t,  where  X = 


11  T 2 

(X  , X , ...»  X ) , iff  t * 0 is  an  eigenvalue  of 
1 2 k 


G and  Y is  an  eigenvector  of  G corresponding  to 


2 T T I 2 T k-1  T 

t , where  Y = (X  ,tX  ,t  X ,...,t  X ). 

12  3 k 


Proof : Pirst  determine  G in  terms  of  the 

sutmatrices  cf  A. 


c0  A 0 . . . 0 jS 


n 

1 

12 

0 

0 

n 

2 

A 

23 

0 

0 

0 

0 

0 ... 
n 

3 

0 

0 

0 

0 

0 ... 

P 

1 

A 

k-1  ,k 

0 

. 

0 

0 ... 

0 

0 

n 

k 
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rfA  A 0 ...  0 

,2 


0 

A A 

21  12 

A 

23 

...  0 

0 

A A 

32  21 

A 

12 

A A 

32  23 

...  0 

k-1 

k-1 

0 

<TT  A . 
1=2  1,1- 

) A 

1 12 

(TT  A . ) A 

1=3  1,1-1  23 

• • • A 

k-1  ,k 

k 

k 

0 

(TT  a . 

1=2  1,1” 

) A 

1 12 

(TT  A ) A 

1=3  i, i-1  23 

• • • A A 

)c,k-1  k-1,k« 

From  this  representation  of  G,  (i)  follows  directly. 

Now  suppose  that  w * 0 is  an  eigenvalue  of  G 

T 

and  Y is  an  eigenvector  of  G corresponding  tc  w,  where  Y = 
IT  T 

(Y  , Y , . . . , Y ).  Then,  wY  = GY  implies: 

2 k 


(3.30)  wY  = A Y 

1 12  2 


and,  for  j = 2,3,...,k-1, 


j j 

(3.31)  wY  = A Y ♦ 5 (TT  A )A  Y 

j 3/3+1  3+1  ",  . i/i-1  s-1,s  s 

s=2  i=s 


One  conseguence  of  (3.31)  is  that,  for  j = 3,4,.  ..,k. 
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(3.32) 


wA  Y 

j»j-1  j-1 


j-1  j-1 


= A . . ,[  I (TT  A.  ) A Y + A Y ] 
3,3-1  1,1-1  s-1  ,s  s 3-1,3  3 

s=2  i=s 


j j 


= l (TT  a.  )A  Y 
1,1-1  s-1,s  s 

s=2  i=s 


Thus,  for  j = 3,4 , . . . , k-1 , (3.31)  and  (3.32)  result  in: 


(3.33)  wY  = A Y + wA  Y 

j j • j*1  j+1  j#  j-1  j-1 

which  is  also  seen  to  hold  for  j = 2 as  a special  case  of 
(3.31).  Finally,  wY  = GY  and  (3.32)  imply: 


(3.34) 


Y = A Y 

k k , k- 1 k-1 


The  relations  (3.30),  (3.  33)  and  (3.34)  are  a set  of 

necessary  and  sufficient  conditions  for  w # 0 to  be  an 
eigenvalue  cf  G and  Y an  eigenvector  of  G corresponding  to 

w . 

The  following  similar  set  of  necessary  and 
sufficient  conditions  for  t # 0 to  be  an  eigenvalue  cf  A and 

T 

X an  eigenvector  cf  A corresponding  to  t,  where  X = 


11  1 

(X  , X , . . . , X ),  can  be  obtained  directly  from  tne  form  of  A 
12  k 

as  specified  in  (3.9): 


(3.35)  tX  = A X 

1 12  2 
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r 


(3.36) 


♦ A X 

j/j-1  j-1 


for  j = 2, . .. , 


* 


tx 


A X 

3/  j+1  j*1 


k- 1 


(3.37) 


tX  = A X 

k k,  k-  1 k-1 


A simple  verification  that  the  conditions  (3.30),  (3.33)  and 

(3.34)  are  equivalent  to  the  conditions  (3.35),  (3.36)  and 
2 i-1 

(3.37)  if  v = t and  Y = t X (for  i = 1,2,. ..,k)  now 

i i 

completes  the  proof. 


Corollary  Let  A be  a 2-cyclic,  irreducible  matrix  in 

third  canonical  form.  If  t , t , ...,  t are  the  distinct 

1 2 m 

eigenvalues  cf  A numbered  so  as  to  satisfy  (3.19),  and  if 


(t  J > |t_|,  then  the  Gauss-Seidel  method  will  converge  to 
2 5 

2 T 

an  eigenvalue  w = t and  an  eigenvector  X,  X = 


11  I T -1  T -2  T 1-k  I T 

(X  , X ,...,X  ),  where  (X  ,t  X ,t  X ,...,t  X ) is  an 

12  k 1i2i3  ik 


eigenvector  cf  A corresponding  to  t for  i = 1,2. 

i 


Proof : 


Since  |t^|  > |t^|  and  w 


2 2 

t = t , w is  the 
1 2 


unique  dominant  eigenvalue  of  the  Gauss-Seidel  iterative 
matrix  of  A by  Theorem  3.12. 


The  importance  of  Theorem  3. 12  and  the  corollary 
following  it  is  brought  into  focus  by  the  realization  that 
arrangement  cf  the  states  according  to  a lexicographic 
ordering  cf  the  1ST AT  Em  1 or  the  ISTATEm2  vector 
representation  results  in  a coefficient  matrix  A in  third 
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canonical  form  for  many  of  the  2-cyciic  models  discussed  in 
the  preceding  chapter.  For  example,  consider  any  central- 
server  model  in  which  all  service  distributions  are 
exponential  and  no  blocking  or  bulking  can  occur.  At  each 
transition  the  number  of  jobs  at  the  CPU  either  increases  by 
one  or  decreases  by  one.  The  result  (see  Appendix  A)  is 
that  each  such  model  is  2-cyclic.  An  ordering  of  the  states 
which  yields  a coefficient  matrix  in  first  canonical  fcrm 
will  necessarily  list  all  of  the  states  having  an  odd  number 
of  jobs  at  the  CPU  followed  (or  preceded)  by  all  of  the 
states  having  an  even  number  of  jobs  at  the  CPU.  the 
ISTATEml  and  ISTAT£m2  orderings  list  all  states  with  N jobs 
at  the  CPU,  followed  by  those  with  N - 1 jobs  at  the  CPU, 
followed  hy  those  with  N - 2 jobs  at  the  CPU,  and  so  forth. 
Since  the  number  of  jobs  at  the  CPU  changes  by  exactly  one 
with  each  transition,  the  resulting  coefficient  matrix  is  in 
third  canonical  form. 

Ihe  corollary  to  Tneorem  3.12  says  that  the 
Gauss-Seidel  method  will  converge  for  these  models.  Note 
that  since  the  Perron- Frobenius  eigenvalue  of  A is  one  in 
these  cases,  the  Perron-Frobenius  eigenvector  of  G coincides 
with  that  of  A.  Thus,  the  Gauss-Seidel  method  will  converge 
to  the  sought-after  eigenvector.  Because  of  this  and  the 
ease  with  which  this  method  is  programmed,  the  Gauss-Seidel 
method  is  the  one  used  in  the  models  programmed  by  the 
author  (see  Chapter  IV)  . 

4.4.  Accelerating  Convergence  of  the  Gauss-Seidel 
Method 

Ncte  that  Theorem  3.11  guarantees  convergence  cf  the 
Gauss-Seidel  method  if  A is  k-cyclic  and  in  first  canonical 

k 

fcrm.  The  measure  of  convergence  is  | t /t  | by  part  (i) , 

k+ 1 1 
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in  contrast  to  the  to  the  relaxed  power  method  where  this 
measure  must  be  expressed  in  terms  of  all  of  the  eigenvalues 
of  A.  In  the  relaxed  power  method  the  dominant  eigenvalues 
of  A are  transformed  to  distinct  eigenvalues  of  the 

iterative  matrix  B . Under  the  conditions  described  in 

w 

Theorem  3.11,  they  are  all  transformed  to  the  same 

(dominant)  eigenvalue  of  the  Gauss-Seidel  iterative  matrix  G 
and,  thus,  will  not  affect  the  rate  of  convergence,  as  they 
could  in  the  relaxed  power  method. 


It  would  be  natural  to  next  ask  if  it  is  possible  to 
improve  the  convergence  properties  of  the  Gauss-Seidel 
method  by  incorporating  a relaxation  procedure.  Indeed, 
since  the  first  two  eigenvalues  of  G are  distinct,  a choice 
of  w > 1 may  be  appropriate.  Incorporation  of  a relaxation 
procedure  may  take  place  in  at  least  two  ways. 


First,  a weighted  sum  of  the  old  vector  and  the  new 
vector  may  be  taken  at  each  iteration.  To  specify  this 
method,  replace  step  (ii)  of  the  power  method  as  specified 
in  the  preceding  subsection  and  replace  step  (iii)  by: 

(i)  (i)  (i) 

(ill)  Let  b.  = ZY  and  X = (w/bJY  + 
i i 


(1-w)X 


<i-1) 


Note  that  X 


U) 


will  be  normalized  since  both  X 


(i-1) 


an  d 


- 1 

b Y 


(i) 


l 


are. 


Second,  a weighted  sum  may  be  taken  as  the  new 
vector  is  generated.  To  specify  this  method,  replace  step 
(ii)  by: 


(ii) 


Caiculat  e 


by  letting 
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(i)  _ (i-l)  % (i-D 

y = w ? a x + (1-w)  x 

1 Ik  k 1 

k=  1 

and,  for  j = 2,3, letting 
j- 1 n 

(i)  r _ (i)  d-1)  . „ 4 (i-D 

y.  = w[  I a y + 2 a x ] + (1-w)  x . 

D ]k  It  ]k  k 3 

k=1  k=j 


Neither  cf  these  two  methods  has  been  investigated,  either 
analytically  cr  empirically. 

Another  promising  acceleration  technique  is  informed 
choice  cf  starting  vector.  Note  from  (3.20)  that  choice  of 

(0) 

starting  vector  X as  nearly  parallel  to  eigenvector  as 

possible  will  cause  small  values  of  c ,c  , . . . ,c  and  earlier 

2 3 m 

convergence  cf  the  iteration  method.  Such  an  informed 
choice  must  he  based  upon  the  physical  situation  modelled 
and  the  anticipated  properties  of  the  final  solution. 


Consider  now  an  irreducible  central-server  model  as 
discussed  in  the  proceding  chapter.  Perron-Frobenius  theory 
tells  us  that  the  solution  vector  (to  (3.1),  (3.3)  and 

(3.4))  is  strictly  positive;  that  is,  all  components  have 
positive  values.  As  remarked  in  subsection  4.1,  a choice  of 
(ncnnull)  starting  vector  with  no  negative  components  will 
guarantee  convergence  of  the  power  method  if  the  model  is 
acyclic.  In  the  case  of  the  relaxed  power  method,  any 
ncnnegative  starting  vector  will  guarantee  convergence  if  0 
< w < 1,  and  in  a wider  range  of  values  for  w if  the  modal 
is  acyclic.  Theorems  3.11  and  3.12  indicate  that  more  care 
must  be  taken  in  the  choice  of  a starting  vector  for  the 
Gauss-Seiael  method.  However,  a positive  starting  vector  is 
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sufficient  fcr  all  three  methods.  The  starting  vector  X 

T 

= (Vn)JL  = (1/n,  1/n ,.  . . ,1/a)  is  one  such  choice  which  is 

easy  to  iaplement.  Of  course,  this  is  an  arbitrary  choice 
and  consideration  of  the  model  parameters  may  lead  to  better 
choices . 


For  example,  a product-form  solution  such  as  that 
discussed  by  Gordon  and  Newell  [46]  can  provide  a starting 
vector.  Gaver  [38]  has  investigated  Gordon  and  Newell's 
formulation  for  the  central- server  model  with  a single  job 
type  and  exponential  servers.  For  this  case  the 
steady-state  probability  that  the  system  is  in  a given  state 

J1  J2  JN 

is  proportional  to  r r ...r  where  for  each  m = 

1 2 N 

1,2,. ..,M,  Jm  is  the  number  of  jobs  at  PPm  in  the  given 

state  and  r is  the  product  of  the  service  rate  at  the  CPU 
m 

and  the  branching  probability  to  PPm  divided  by  the  service 

rate  at  EPm.  Since,  in  general,  different  job  types  have 
different  service  rates  and  branching  prooabilities,  several 
states  of  a system  such  as  those  described  in  the  preceding 
chapter  have  J1  jobs  at  p?1,  J2  jobs  at  PP 2 , ...,  JM  jobs  at 
EPM,  and  some  technique  must  be  devised  for  developing  a 
starting  vector  from  a product-form  solution.  One  technique 
is  to  use  composite,  or  averaged,  service  rates  and 
branching  probabilities.  Once  the  product  indicated  above 
has  been  determined,  it  can  either  be  assigned  to  each  state 
having  Jo  jots  at  PPm  (m  = 1,2,...,M)  or  split  among  them. 

Jo  Jim  J2m 

Another  technique  is  to  replace  r by  r r where  Jim  is 

m 1 m 2m 

the  number  of  type-i  jobs  at  PPm  and  r is  the  product  of 

im 
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the  service  rate  of  type-i  jobs  at  the  CPU  and  the  branching 


1 


probability  cf  type-i  jobs  to  PPm  divided  by  the  service 
rate  of  type-i  jobs  at  PPm. 

Another  example  of  how  system  parameters  might  be 
used  to  provide  a good  starting  vector  is  to  base  the 
relative  values  of  the  components  of  the  starting  vector 
upcn  the  following  considerations: 

(i)  If  the  service  rates  at  the  CPU  are  large  as 
compared  to  those  at  the  PP's,  and  if  M is 
relatively  small,  there  is  a smaller  likelihood  of 
finding  a large  number  of  jobs  at  the  CPU  than  a 
small  number.  The  opposite  is  true  if  the  service 
rates  at  the  CPU  are  of  the  same  order  as  or 
smaller  than  those  at  the  PP's. 

(ii)  If  the  branching  probability  of  type-i  jobs 
to  FEj  is  significantly  smaller  than  that  of  the 
same  type  jobs  to  PPk,  there  is  a smaller 
likelihood  of  finding  a given  number  of  type-i 
jobs  at  PPj  than  finding  tae  same  number  at  PPk. 

(iii)  If  the  service  rate  of  type-j  jobs  is 
smaller  than  tnat  of  type-k  jobs  at  a given 
processor,  tnere  is  a smaller  likelihood  of 
finding  a type-k  job  in  service  there  than  a 
type-j  job. 

These  guidelines  are  purposefully  vague  and  no 
indication  has  been  given  as  to  how  they  might  be  used  to 
develope  a starting  vector.  The  question  of  acceleration  of 
the  Gauss-Seidel  iterative  method,  in  general,  and  choice  of 
a "good"  starting  vector,  in  particular,  is  an  open  area  for 
research . 
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IV. 


PROGRAMMED  MODELS 


This  chapter  is  devoted  to  a discussion  of  three  models 
which  have  been  programmed  using  the  technigues  developed  in 
Chapter  II.  Ihe  programs  have  been  written  in  FORTRAN  and 
are  currently  operational  on  the  IBM  360-67  at  the  Naval 
Postgraduate  School  in  Montery,  California.  In  the  first 
section  the  models  and  programs  are  discussed.  The  second 
section  contains  the  results  of  a variety  of  numerical 
examples  designed  to  contrast  the  models  to  each  other  and 
to  approximate  product-form  solutions  of  some  of  the  same 
problems . 

1.  DESCRIPTION  OF  MODELS  AND  PROGRAMS 

Tne  first  subsection  of  this  section  contains  a 
discussion  of  the  models  which  have  been  programmed.  The 
second  subsection  considers  the  similarities  in  the  three 
pregrams,  and  the  final  subsection  considers  their 
differences. 


1.1.  The  Models 

All  three  models  are  closed  central-server  models  as 
depicted  in  Figure  1.1.  Service  distributions  at  all 
processors  are  exponential.  Two  types  of  jobs  are 
considered,  and  service  rates  and  branching  prebaoilities 


The  first  model  is  the  key  example  discussed  in 
Chapter  II.  Each  processor  is  a FCFS,  single  server  gueue. 
Hereafter,  this  model  is  called  the  FCFS  model.  Appendix  D 
contains  a listing  of  the  FORTRAN  program  associated  with 
this  model.  In  the  remainder  of  this  chapter  this  program 
will  be  referred  to  as  the  FCFS  program. 

The  second  model  is  identical  to  the  FCFS  model 
except  that  the  CPU  has  a PS  queuing  discipline.  For  this 
reason  this  ncdel  is  hereafter  called  the  PS  model.  A 
listing  of  the  associated  program,  the  PS  program,  is  found 
in  Appendix  E. 

In  the  third  model  PP1  is  an  IS  gueue  which  services 
only  typs-twc  jobs  (ALFA (1,1)  = 0,  to  use  notation 
introduced  in  the  next  subsection) , and  the  CPU  is  a 
mulriserver  FCFS  gueue.  An  application  of  this  model  will 
be  discussed  in  section  3 of  Chapter  VI.  In  this 
application  PP 1 represents  all  of  the  tape  drives  in  a 
computer  system,  and  the  multiserver  CPU  represents  multiple 
CPU's  with  a common  waiting  line.  Only  type-two  jobs 
reguire  the  use  of  tapes.  This  model  is  hereafter  called 
the  tapes  model.  A listing  of  the  tapes  program  is  found  in 
Appendix  F. 

Having  introduced  the  models,  attention  is  now 
directed  toward  the  programs. 

1.2.  Similarities  in  the  Programs 

Ihe  major  variable  names  are  common  to  the  three 
programs.  Appendix  G contains  a glossary  of  these  variable 
names.  Several  are  also  defined  in  this  subsection.  ethers 
have  already  been  used  in  Chapter  II. 
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The  number,  NPP,  of  FP's  is  an  input  parameter  in 
all  three  pregrams.  (In  previous  chapters  this  number  has 
been  represented  by  H , but  in  the  programs  it  is  NPP.)  NPP 
is  restricted  to  be  no  smaller  than  two  and  no  larger  than 
nine.  The  lower  bound  is  a natural  restriction  in  the  tapes 
model  (the  type  one  jobs  have  to  route  somewhere  when  they 
complete  service  at  the  CPU)  and  is  necessary  for 
irreducibility  in  the  FCFS  model.  The  upper  bound  is  to 
help  insure  that  the  right  subvector  (see  Chapter  II, 
subsection  3.1)  can  be  stored  as  a single- precision  integer. 
This  bound  can  be  relaxed,  but  not  without  a careful 
reprogramming  effort. 

The  number,  N1,  of  type-one  jobs  and  the  number,  N2, 
of  type-twc  jobs  are  input  in  all  three  programs.  Both  N1 
and  N2  are  restricted  to  oe  nonnegative  and  their  sum  must 
net  exceed  nine.  The  upper  bound  is  to  insure  that  the  left 
subvector  (see  Chapter  II,  subsection  3. 1)  can  be  stored  as 
a single-precision  integer.  Together  with  the  upper  bound 
on  NPP,  the  upper  bound  for  N1  + N2  insures  that  the  right 
subvector  can  also  be  so  stored. 

The  tapes  program  will  reject  any  case  in  which  N1  = 
0 or  N2  = 0.  If  N 1 = 0,  the  FCFS  program  and  the  PS  program 
will  decrease  N2  by  one,  increase  N1  to  one,  replace  the 
service  rates  and  branching  probabilities  for  type-one  jobs 
by  those  for  type-two  jobs,  and  solve  the  problem  as  though 
there  were  actually  two  types  of  jobs.  (The  case  in  which 
N2  = 0 is  treated  similarly.)  Because  of  this  N1  ♦ N2  is 
restricted  to  be  no  smaller  than  two.  The  reader  is 
cautioned,  however,  that  output  referring  to  job  type  (for 
example,  the  probability  that  PP2  is  busy  with  a type-cne 
jot)  loses  meaning  when  N1  = 0 or  N2  = 0 initially.  Note 
that  any  case  in  which  there  is  only  one  job  type  can  be 
solved  using  a product-form  solution.  For  the  FCFS  model 
the  reader  is  referred  to  Gaver  [38].  For  the  other  two 
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models  see  Easkett,  Chandy,  Muntz  and  Palacios  £6]. 


r 


* 


For  each  job  type  i = 1,2  and  each  PPj,  j = 

1 , 2 , . . . , NPP , the  branching  probability,  ALFA  (i, j) , of  a type 
i job  to  PPj  is  also  an  input  parameter.  If,  for  some  j = 

-6 

1,  2,  KNE,  ALFA  (i, j)  < 0.5  x 10  for  both  i = 1 and  i 

= 2,  then  PF;  is  eliminated  from  consideration,  the  PP's  are 
renumbered  (if  j * NPP),  and  NPP  is  decreased  by  one.  NPP 
must  satisfy  the  restrictions  indicated  above  after  all  such 

-6 

trimming  has  taken  place.  If  | ALF A (i, j)  | < 0.5  x 10  for 

some  i and  j,  then  ALFA  (i , j ) is  set  equal  to  zero.  If  any 
ALF  A (i , j ) is  negative,  an  error  message  is  printed  and  the 
problem  is  net  solved. 

For  each  job  type  i = 1,2  and  each  processor  j = 1, 

2,  ...,  NPP  ♦ 1 (processor  NPP  t 1 is  the  CPU),  the  service 
rate,  KATE  (i , j) , cf  type  i jobs  at  processor  j is  an  input 

-6 

parameter.  If  any  such  rate  is  smaller  than  0.5  x 10  , an 

error  message  is  printed  and  the  problem  is  not  solved. 

Note  that  tests  are  performed  in  the  order  that  the 
restrictions  are  presented  here.  Hence,  a negative 
branching  probability  or  service  rate  will  net  cause 
abortion  cf  the  problem  if  the  affected  PP  is  eliminated,  or 
if  it  is  for  type-one  jobs  and  N1  = 0. 

Each  program  is  divided  into  a main  routine  and 
seven  subroutines: 

MAIN:  Controls  flow  of  the  program;  contains  read 

statements  for  input;  develops  balance  equations. 

CKOUT:  Checks  input  parameters  for  adherence  to  the 

above  restrictions. 

INIT:  Stores  the  right  and  left  subvectcrs  and 
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associated  pointer  vectors. 

LOOKUP:  Calculates  the  state  number  from  the  vector 

representation. 

PIG:  Calculates  the  number  of  combinations  of  n + 

1 

n things  taken  n at  a time. 

2 1 

GSSOL:  Selves  the  balance  equations. 

PSNTP:  Prints  the  steady-state  probability 

distributions  (no  more  than  one  thousand  states) . 

ACCUM : Calculates  and  prints  the  measures  of  system 

performance. 

Subroutines  PIG,  GSSOL  and  PRNTP  are  the  same  for  all  three 
programs.  CKCOT  is  the  same  in  the  FCFS  and  PS  programs. 
Although  the  coding  differs  in  the  tapes  program,  the  same 
tests  are  performed  in  CKOUT  of  the  tapes  program. 

The  Gauss-Seidel  iterative  method,  discussed  in 
subsection  4.3  of  Chapter  III,  is  used  in  GSSOL  to  solve 
the  balance  equations.  Each  component  of  the  starting 
vector  is  equal  to  1/NSTAIS,  where  NSTATE  is  the  number  of 
states  (and  balance  equations) . The  method  is  considered  to 
have  converged  if 

(n)  (n-1)  (n)  -6 

(4.1)  max  |X  - X | / X < 0.5  x 10 

i i i 

1<i<NSTATE 


(n)  (n-1) 

where  X and  X are  the  i-th  components  of, 

i i 

respectively,  the  n-th  and  the  (n-l)-st  generated  vector. 

(n)  (n) 

The  solution  method  guarantees  that  X > 0.  X is 

i i 

assumed  to  be  zero  if  it  is  calculated  to  be  less  than 
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0.5  x 10 


1 


-27  <n) 

. In  the  case  that  X is  zero,  the  fraction  in 

i 

(n-1) 

(4.1)  is  set  egual  to  zero  if  x is  zero  or  one  if  not. 

i 

If  convergence  has  not  been  attained  in  five  hundred 
iterations  of  the  Gauss-Seidel  method,  a message  is  printed 
and  the  problem  is  aborted.  The  convergence  criterion  used 
here  is,  admittely,  very  stringent.  However,  it  permits  the 
luxury  of  not  normalizing  until  convergence  has  been 
attained.  All  variables  and  calculations  are  single 
precision . 

The  (nonoptional)  output  for  all  three  programs 
consists  cf  the  input  parameters,  the  total  number  of 
states,  the  cumber  cf  nonzero  terms  in  the  balance 
eguations,  the  number  of  iterations  for  convergence  of  the 
Gauss-Seidel  method,  and  for  each  processor:  the  idle 
probability,  the  probability  that  it  is  busy  with  each  type 
of  job,  the  average  occupancy,  and  the  average  length  of 
waiting  line.  Optional  output  includes  the  state  vectors, 
the  balance  eguaticns  and  up  to  one  thousand  steady-state 
prctabilities. 

Having  considered  the  similarities  in  the  three 
programs,  a discussion  of  the  differences  is  in  order. 

1.3.  Differences  in  the  Programs 

Fcr  the  tapes  program  the  number,  HP,  of  CPU's  (i. 
e.,  the  number  of  servers  at  the  CPU)  is  an  input  parameter. 

This  number  is  set  egual  to  one  if  a nonpositive  number  is 
provided  through  the  read  statement.  Note  that  the  CPU  can 
be  made  an  icfinite  server  gueue  by  setting  the  number  of 
servers  egual  to  any  number  greater  than  or  egual  to  N1  + 

N2. 
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The  sequencing  of  the  states  is  according  to  a 
lexicographic  ordering  of  the  iSTATEml  vector 
representations  for  the  FCFS  and  PS  models  and  according  to 
a lexicographic  ordering  of  a slightly  modified  version  of 
the  ISTATEm2  vector  representations  for  the  tapes  model. 

The  modification  used  in  the  tapes  model  would  list  the  jobs 
at  PP 1 (necessarily  all  twos)  at  the  right  end  rather  than 
the  left  end  cf  the  left  subvector. 

In  addition  to  the  nonoptional  output  indicated  in 
1.2,  the  tapes  program  prints  the  average  number  of  each 
type  job  at  each  processor,  the  average  number  of  CPU's  busy 
with  each  type  of  job,  the  average  number  of  CPU's  which  are 
idle,  the  distributions  from  which  many  of  these  averages 
are  calculated  (e.g.,  the  distribution  of  the  number  of  idle 
CPU's),  and  throughput  for  each  processor.  The  throughput 
of  a processor  is  the  average  number  of  jobs  completing 
service  at  that  processor  per  unit  time.  It  may  be 
calculated  fcr  a single  server  FCFS  processor,  for  example, 
by  multiplying  the  processing  rate  for  each  type  job  by  the 
proportion  of  time  the  server  is  busy  with  that  type  of  job 
and  accumulating  over  all  job  types. 


2.  NUMERICAL  RESULTS 

Numerical  results  from  utilization  of  the  three  programs 
discussed  in  the  first  section  of  this  chapter  are  given  in 
this  section.  The  results  given  in  the  first  subsection 
shew  how  the  three  models  can  to  ways  in  which  some  cf  these 
models  might  be  approximated  by  models  be  compared  for  a 
particular  example.  The  second  subsection  is  devoted 
satisfying  the  conditions  of  local  balance.  The  chapter  is 
concluded  with  seme  indicaticns  of  running  times  and  core 
requirements  fcr  relatively  large  jobs. 
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2.1.  Use  of  the  Programs  to  Examine  Changes  in  CPU 
Configuration 

Easkett,  Chandy,  Muntz  and  Palacios  £6]  considered 

the  network  depicted  in  Figure  4. 1.  The  queuing  discipline 

at  the  CPU  is  PS  and  each  peripheral  is  a single  server  FCFS 

queue.  The  rates  for  the  exponential  service  distributions 

are  given  below  the  box  representing  the  corresponding 

processor  (for  example,  r is  the  service  rate  of  type-one 

1 5 

jobs  at  the  CPU) . Only  the  nonzero  branching  probabilities 

are  given  in  Figure  4.1.  Since  each  peripheral  sees  only 
one  type  cf  job,  the  system  satisfies  the  conditions  of 

local  balance.  Thus,  Easkett,  et.  al.  were  able  to  use  a 

» 

prcduct-fcr m solution  to  determine  the  utilization  of  each 
prccessor  as  the  number  of  type-one  jobs  increased  and  the 
numoer  of  type-two  jobs  remained  fixed  at  one.  The  idleness 
probabilities  (one  minus  tae  utilization)  for  the  cases 
reported  by  Easkett,  et.  al.  are  given  in  the  first  column 
of  Table  4.1. 


Ncte  that  this  example  is  one  which  the  PS  model  is 
designed  to  handle.  The  PS  program  was  used  to  verify  the 
results  reported  in  [ 6 ] and  to  provide  the  average 
occupancies  and  throughputs  as  reported  (for  the  same 
example)  in  the  first  column  of  Tables  4.2  and  4.3 
respectively . 

Ihe  EC FS  program  was  used  to  give  the  second  column 
in  these  three  tables.  A comparison  of  the  first  two 
columns  of  each  table  reveais  the  effect  of  changing  the  PS 
CPU  to  a FCFS  CPU.  Note  that  the  differences  become  mere 
pronounced  as  the  number  of  jobs  increases. 
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Figure  4.1--Network  of  Baskett,  et.  al.  Example 


mm 


TABLE  4.1 

IDLENESS  PROBABILITY  FOR  BASKETT,  et.  al.  MODEL 


CPU  queuing 
discipline 

PS 

FCFS 

FCFS 

FCFS 

FCFsj 

FCFS 

1 

FCFS  j 

FCFS 

FCFS 

Number  CPU's 

1 

1 

2 

3 

4 

5 

6 

7 

8 

Processor 

CPU 

jn_ 

i 

.322 

. 320 

. 634 

.765 

! 

1 

.317 

.854, 

.878 

. 395 

. 909 

CPU 

2 

.230 

. 271 

. 598 

.731 

.799 

. 839 

.866 

. 865 

. 899 

CPU 

3 

. 256 

. 238 

.577 

.717 

.738 

.830 

.859 

. 879 

.894 

CPU 

4 

. 24  1 

.214 

1.564 

.709 

.782 

.825 

.854 

. 875 

.89  1 

CPU 

i c 

. 231 

. 197 

.556 

.704 

.773 

.322 

.857 

. 873 

. 889 

CPU 

6 

. 225 

. 184 

. 55  1 

. 700 

. 775 

.320 

.350] 

.872 

. 888 

CPU 

7 

.221 

. 175 

. 548 

.698 

. 774 

.819 

.849| 

. 371 

.887 

pp  1 

| 1 

.629 

.6  05 

.600 

.600 

.600 

.600 

.6001 

. 600 

.600 

pp  1 

2 

.648 

.6101 

.6001 

.600 

.600 

.600 

.600, 

. 600 

. 600 

pp  1 

« 

.661 

.6  15 

.60C| 

.600 

• 600| 

.600 

.600] 

. 600 

. 600 

P?1 

4 

. 670 

.620, 

. oO  1 | 

.600 

. 6 0 0 1 

.600 

. 600 , 

. 600 

.600 

PP1 

| 5 

. 676 

. o 24 

.6011 

.6  00 

.600; 

- 6 0 0 i 

.600] 

.600 

.600 

PP1 

6 

.67  9 

. 6 28 

.601 

.600 

. 0 0 0 

.600 

.600 

.600 

.600 

pp  1 

7 

.632 

.631 

.601 

.600 

.600, 

.600] 

.6  0 Oj 

.600 

. 600 

PP2 

1 

.616 

.7  26 

.586 

.5  86 

. 586 ! 

.586 

. 5 86  | 

. 586 

.586 

PP2 

2 

.394 

. 546 

.357 

.352 

. 352; 

. 3521 

.352] 

. 352 

. 352 

PP2 

"2 

. 257 

.4  17 

.224 

. 2 1 3 | 

.2181 

-218| 

.2  13 

. 2 18 

.218 

PP2 

4 i 

. 169 

.320 

. 14  3 

. 138 

.138, 

. 133] 

.138, 

. 138 

. 133 

PP  2 

c 

. 1 12 

| .2461 

. 093 

.089 

. 08 9 j 

1 . 089| 

.089| 

. 089 

.089 

PP2 

6 

.074 

.1881 

. 061 

. 058 

. 05 8 1 

• 058| 

.058, 

. 058 

.053 

PP2 

7 

.049 

.143 

. 04  0, 

.038 

. 038] 

.038| 

• 033| 

. 038  i 

.038 

PP3 

1 

. 744 

. 8 1 7 1 

. 724 

.724, 

.724 

.724 

. 724  j 

.724 

.724 

PP  3 

2 

. 596 

.6971 

. 57  1 

. 568 

. 563 

. 563 

. 5631 

. 568 

. 563 

PP3 

2 

.505 

.6111 

. 483 

.479 

.479| 

.479 

.479| 

. 479 

.479 

PP3 

4 

. 446 

. 547| 

.429 

. 426 

. 425] 

. 425 

.425, 

. 425 

. 425 

PP3 

c 

.403 

. 4 97  i 

.395 

.393 

.393| 

.393 

.3931 

. 393 

. 393 

PP3 

6 

. 383 

. 4 59  i 

. 374 

.372 

. 372 

. 372 

• 372| 

. 372 

. 372 

PP3 

7 

.366 

. 4291 

.360 

.359 

.359 

.359 

• 359| 

.359 

. 359 

PP4 

1 

.335 

. 883 

. 322 

.322 

. 322 

. 822 

.822 

. 8 22 

.822 

PP4 

2 

. 74  0 

.805 

.724 

.722 

.722 

.722 

.7221 

. 722 

| .722 

PP4 

2 

.632 

.750, 

.667 

.665 

.665 

.6  65 

.6651 

. 665 

.66  5 

PP4 

4 

.644 

.709 

.633 

. 631 

. 631 

.631 

.631  | 

. 631 

.631 

PP4 

5 

.0  19 

.6771 

.611 

.610 

. 0 1 0 1 

.6  10 

. 0 1 0 i 

.610 

.610 

PP4 

6 

.603 

. 6 5 2 1 

.597 

.5  96 

. 596, 

.596 

.596] 

. 596 

. 596 

PP4 

L_2_J 

. 5 93J 

L-_633j 

. 58  8J 

.388 

. 588, 

.588] 

.58  8 

. 588 
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TA3LE  4.2 

AVERAGE  OCCUPANCIES  FOB  EASKEIT,  et . al.  MODEL 


I "CPU  gueuing 
discipline 

INumber  CPU's 

PS 

1 . 

FCFS 

"T1 

PC-FS 

2 , 

FCFS, 

FCFS 

4 

.FCFS. 

_ 

D 

FCFS 

6 

FCFS 

----- 

FCFS. 

8 

Processor 

J1_ 

CPU 

1 

.824 

1.03 

.732 

.732 

.732 

.732 

.732 

.732 

.732 

CPU 

2 

.999 

1.41 

.919 

. 806 

.806 

.806 

.806 

. 806 

. 806 

CPU 

3 

1.13 

1.74 

.877 

. 849 

. 848 

.848 

.848 

. 848 

.843 

CPU 

4 

1.23 

2. 04 

.916 

.876 

. 874 

.874 

.874 

. 874 

. 874 

CPU 

5 

1 . 30 

2. 30 

. 94  1 

.8  92 

. 889 

.889 

.889 

.869 

. 889 

CPU 

6 

1 . 36 

2.52 

. 959 

.903 

.399 

.899 

.399 

. 899 

. 899 

CPU 

7 

1.39 

2.  72 

. 971 

. 909 

. 90  6 

. 905 

.905 

. 905 

. 905 

PP1 

1 

.37  1 

.395 

. 40  0 

.400 

. 400 

.400 

.400 

. 400 

.400 

P?1 

2 

.352 

.390 

.4  00 

.400 

.400 

.400 

.400 

. 400 

.400 

PP 1 

3 

. 339 

.385 

. 400 

.400 

.400 

.400 

.400 

. 400 

. 400 

PP 1 

4 

.330 

.3  80 

.399 

.400 

.400 

.400 

.400 

. 400 

. 400 

PP  1 

5 

.324 

.3  76 

.399 

.400 

. 400 

.400 

.400 

. 400 

. 400 

p?  1 

6 

. 32  1 

.3  72 

.399 

.400 

.400 

.400 

.4  00 

. 400 

.400 

P?1 

7 

.318 

.369 

.399 

.400 

.400 

.400 

.400 

. 400 

.400 

PP2 

1 

. 384, 

. 274 

.4  14 

. 4 14 

.4  14 

.4  14 

.4  14 

.4  14 

.414 

PP2 

2 

.839 

. o02 

.910 

.916 

.916 

.916 

.916 

. 9 16 

.916 

PP2 

3 

1.37 

.980 

1.48 

1.  50 

1 .50 

1 . 50 

1.50 

1 .50 

1.50 

PP  2 

4 

1.97 

1.41 

2.  1 3 

2.15 

2.  1 5 

2.  15 

2.  15 

2.  15 

2.15 

P?  2 

5 

2.63 

1.  89 

2.83 

2.  87 

2.87 

2.  87 

2.87 

2.37 

2.87 

PP  2 

6 

3.36 

2.42 

3.60 

3.65 

3.65 

3.65 

3.65 

3.65 

3.65 

PP2 

7 

4. 15 

3.  00 

4.42 

4.47 

4.47 

4.47 

4.47 

4.47 

4.47 

PP3 

1 

. 256 

. 183 

. 276 

. 276 

. 276 

. 276 

.276 

. 276 

.276 

PP  3 

.50  8 

. 373 

.547 

.551 

.551 

.551 

.551 

. 551 

.55  1 

PP3 

3 

.747 

.567 

.80  1 

.308 

. 809 

.809 

.809 

. 309 

.309 

PP  3 

4 

.96  8 

.758 

1 . 03 

1.04 

1 . 04 

1.041 

1.04 

1 .04 

1.04 

PP3 

5 

1.16 

.9  44 

1.  23 

1.2411.24 

1 . 24 

1.24 

1.24 

1.24 

PP3 

6 

1.34 

1.  12 

1.39 

1.41 

1.41 

1.41 

1.41 

1.4  1 

1.41 

PP3 

7 

1.48 

1.29 

1 . 53 

1.  54 

1.54 

1 . 54 

1.54 

1 . 54 

1 .54 

PP4 

1 

.165 

. 1 17 

. 178 

. 173 

. 178 

. 178 

.178 

. 173 

. 178 

PP4 

2 

.303 

. 226 

. 325 

.327 

. 327 

.327 

.327 

. 327 

. 327 

PP4 

3 

.415 

.325 

. 44  1 

.445 

.445 

.445 

.445 

. 445 

.445 

PP4 

4 

. 504 

. 4 14 

.529 

.533 

. 534 

.534 

.5  34 

. 534 

. 534 

PP4 

5 

.57  2 

.493 

. 595 

. 599 

. 599 

.599 

.599 

. 599 

.599 

PP4 

6 

.624 

.562 

. 642 

.645 

.64  6 

. 646 

.646 

. 646 

. 646 

PP4 

2_J 

t . 66  1j 

.621 

.676 

b.678 

.679 

.679 

. b79 

. 679 

.679 
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TABLE  4.3 

IHBOUGHPUI  ?OA  BASKETT,  et.  al.  MODEL 


CPTJ  gueulng 
discipline 

PS 

FCFS 

FCFS 

FCFS 

FCFS 

FCFS 

FCFS 

FCFS 

FCFS. 

Number  CPU's 

1 

-j 

2 

3 

4 

5 

6 

7 

8 

Processor 

CPU 

NJ^ 

1 

1.65 

“ 

1.  38 

1 .78 

1.78 

1.78 

1 . 78 

1.78 

1 .78 

1.78 

CPU 

2 

2.26 

1 . 88 

2.44 

2.45 

2.45 

2.45 

2.45 

2.45 

2.45 

CPU 

3 

2.63 

2.  24 

2.82 

2.83 

2.  83 

2.83 

2.33 

2.83 

2.83 

CPU 

4 

2.87 

2.51 

3.05 

3.06 

3.06 

3.06 

3.06 

3.06 

3.0b 

CPU 

5 

3.02 

2.72 

3.19 

3.20 

3.20 

3.  20 

3.20 

3.20 

3.20 

CPU 

6 

3.13 

2.88 

3.28 

3.29 

3.29 

3.29 

3.29 

3.29 

3.29 

CPU 

7 

3.19 

3.00 

3 .34 

3.35 

3.35 

3.35 

3.35 

3.35 

3.35 

?P1 

1 

.556 

.593 

.600 

.600 

.600 

. 6 00 

.600 

. 600 

. 600 

PP  1 

2 

. 527 

. 585 

.600 

. 600 

.600 

.600 

.600 

. 600 

.600 

PP  1 

3 

.50  8 

. 577 

.599 

.600 

. o 0 0 

.600 

. b 0 0 

.600 

. 600 

PP1 

4 , 

. 495 

. 570 

. 599 

. 600 

. 60  0 

. 6 00 

.600 

.60  0 

.600 

PP  1 

3 

.487 

. 5 64 

.599 

.600 

.600 

.600 

.600 

. 600 

.600 

P?1 

6 

. 48  1 

.558 

. 599 

.600 

.600 

.600 

.600 

. 600 

. 600 

PP  1 

7 

.477 

.553 

.599 

.600 

.600 

.600 

.600 

. 600 

.600 

PP2 

1 

. 38  4 

.274 

. 4 14 

. 4 14 

. 4 14 

.4  14 

.4  14 

. 414 

.414 

PP2 

2 

. 606 

.454 

.64  3 

. 647 

.64  7 

.647 

.647 

. 647 

. 64  7 

PP2 

.743 

.5e3 

. 776 

.782 

.732 

.782 

.782 

.782 

.732 

PP2 

4 

.331 

. 630 

. 857 

.86  1 

.8b2 

. 862 

.862 

. 86  2 

. 86  2 

PP2 

5 

.888 

.7  54 

.907 

.911 

.91  1 

.911 

.911 

.911 

.911 

PP2 

6 

. 92  6 

.312 

. 93  9 

. 942 

. 942 

. 942 

.942 

. 942 

. 942 

PP2 

7 

.951 

. 857 

. 960 

.962 

. 962 

. 962 

.962 

. 9b  2 

. 96  2 

PP3 

1 

. 38  4 

.2  74 

.414 

. 4 14 

.4  14 

.4  14 

.4  14 

. 4 14 

.414 

PP3 

2 

.606 

. 454 

. 643 

. 648 

.64  8 

. 648 

. 648 

. 648 

. 648 

PP  3 

3 

.743 

.5  83 

. 776 

.782 

.732 

.782 

.782 

.782 

.762 

PP3 

4 

. 83  1 

. 680 

. 357 

. 862 

. 862 

. 6o  2 

. 3o  2 

. 862 

. 362 

PP3 

5 

.388 

.7  54 

. 907 

.9  11 

.911 

.911 

.911 

.911 

.911 

PP3 

6 

. 926 

.312 

. 939 

.942 

. 942 

. 942 

. 942 

. 942 

.942 

PP  3 

7 

.951 

. 857 

. 960 

.962 

. 962 

. 962 

. 96  2 

. 96  2 

.96  2 

PP4 

1 

. 329 

.235 

. 355 

.355 

.35  5 

.355 

355 

. 355 

. 355 

PP4 

2 

.520 

.389 

. 5b  1 

. 555 

. 555 

.555 

8 55 

. 555 

. 555 

PP4 

.637 

.500 

. 665 

.670 

.67  0 

.670 

.739 

e>7  0 

.670 

.670 

| PP4 

4 

.712 

.583 

. 734 

.739 

.739 

.739 

. /j9 

. 7 j9 

PP4 

5 

.76  1 

. 6 46 

. 773 

.781 

.781 

.731 

.78  1 

.781 

.78  1 

i PP4 

1 PP4 

6 

.793 

.696 

. 805 

. 307 

.308 

. 808 

. 808 

. 308 

.803 

.31  5j 

LiUi. 

. 32 3j 

.^25j 

LL325j 

. 325 

Liiij 

L.  3 2 5 J 

. 825 
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Since  only  type-two  jobs  are  allowed  to  route  to 
FP1,  and  since  only  one  type-two  job  is  considered,  PP 1 is 
an  IS  queue  and  the  tapes  program  can  be  used  to  determine 
the  effect  cf  increasing  the  number  of  (FCFS)  CPU's.  This 
was  done  and  the  results  are  also  reported  in  the  three 
tables. 

Consider  in  more  detail,  now,  the  effect  of 
replacing  a ES  CPU  with  a FCFS  CPU  in  a model  such  as  than 
depicted  in  Figure  4.1.  Since  the  operations  are  exactly 
the  same  in  the  two  models  except  when  the  system  is  in  a 
state  in  which  two  or  more  jobs  occupy  the  CPU,  only  these 
states  will  be  considered.  In  the  PS  CPU  each  job  receives 
service  immediately  upcn  arrival.  However,  the  rate  of  this 
service  is  degraded  according  to  the  number  of  jobs  which 
occupy  tne  CPU.  In  the  FCFS  CPU  there  is  no  degradation  of 
service.  This  fact  supports  a tendency  toward  shorter 
occupancy  times  (waiting  time  plus  service  time)  for 
individual  jobs  and,  therefore,  greater  throughput  for  the 
FCFS  CPU  than  for  tne  PS  CPU.  However,  this  tendency  is 
counterbalanced  by  the  fact  that  jobs  must  wait  in  turn  for 
service  in  the  FCFS  CPU,  but  receive  service  immediately  in 
the  PS  CPU.  This  latter  effect  becomes  dominant  if  the 
service  rates  for  one  type  of  job  is  larger  at  the  CPU  and 
the  PP' s than  that  for  the  other  type  of  job  is  at  the  CPU. 

Such  a case  is  exemplified  in  the  model  by  Haskett, 
et . al.  [6]  discussed  above  and  depicted  in  Figure  4.1.  In 
this  example  the  service  rates  for  the  type-cne  jobs  are 
larger  at  most  PP's  and  much  larger  at  the  CPU  than  the 
service  rate  for  type-two  jobs  at  the  CPU.  In  the  PS  model 
a type-one  jcb  arriving  at  the  CPU  after  a type-two  jot 
might  complete  service  at  the  CPU,  receive  service  at  cne  of 
the  PP's  and  return  to  the  CPU  several  times  before  the 
type-two  job  leaves  the  CPU.  In  the  FCFS  model  the  type-one 
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jot  would  be  forced  to  wait  for  service  until  the  type-two 
job  left  the  CPU.  As  emphasized  in  the  preceding  paragraph, 
the  effects  of  degraded  service  in  the  PS  model  are 
counterbalanced  by  the  effects  of  forced  waiting  in  the  FCFS 
model.  However,  as  can  be  seen  in  Table  4.3,  the  net 
result  in  the  cases  for  which  data  are  given  is  a decrease 
in  throughput  at  the  CPU  when  the  PS  CPU  is  replaced  by  a 
FCFS  CPU.  This  results  from  a decrease  in  the  throughput 
for  type-cne  jobs  and  an  increase  for  type-two  jobs,  as  can 
be  seen  bj  examining  the  throughput  at  the  PP's.  From 
Tables  4.1  and  4.2  it  is  also  seen  that  idleness 
prc babil ities  decrease  at  the  CPU  and  PP1  and  increase  at 
PE2,  PP3  and  PP4,  and  average  occupancies  increase  at  the 
CPU  and  PEI  and  decrease  at  PP2,  PP3  and  PP4 . 

The  difference  in  results  between  the  PS  model  and 
the  FCFS  model  increase  as  the  number,  HI,  of  type-cne  jobs 
increases,  while  the  number  of  type-two  jobs  remains 
cccstatn  at  one.  The  reason  for  this  is  that  the 
degradation  cf  service  in  the  PS  CPU  becomes  less  serious 
for  the  type-cne  jobs  and  more  serious  for  the  type-two  job 
as  the  number  of  jobs  at  the  CPU  increases.  For  example, 
with  one  job  of  each  type  at  the  CPU,  the  rate  of  departure 
of  jobs  from  the  CPU  is  9/2  for  type-one  jobs  and  1/2  for 
type-two  jobs.  Increasing  the  number  of  type-one  jobs  to 
four  changes  these  rates  to  36/5  and  1/5. 

Finally,  consider  the  effect  of  increasing  the 
number  of  (FCFS)  servers  at  the  CPU.  Note  that  in  those 
cases  in  which  the  number  of  type-one  joos  is  smaller  than 
the  number  of  CPU's,  the  CPU  has  an  IS  queuing  discipline. 
From  this  point  on,  increasing  the  number  of  CPU's  has  no 
effect  on  the  operation  of  the  network.  The  reason  that 
idleness  probabilites  in  Table  4.1  continue  to  change  past 
this  point  for  the  CPU  is  that  they  were  found  by  dividing 
the  average  number  of  idle  CPU's  by  the  total  number  of 
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CPU's.  If  each  idle  CPU  has  an  equal  chance  of  being  chosen 
by  a newly  arriving  job,  this  idleness  probability  is  the 
proportion  of  time  that  each  CPU  is  found  idle.  Since  ti-rse 
IS  CPU  cases  provide  immediate,  full  service  (as  opposed  to 
the  delayed  service  of  the  PCPS  CPU  and  the  degraded  service 
of  the  PS  CPU)  throughput  is  a maximum  for  all  processors. 
Idleness  probability  is  small  and  average  occupancy  large 
(relative  to  all  other  cases  reported  for  the  same  job  mix) 
at  the  PP's. 

As  the  number  of  servers  at  the  CPU  increases  from 
one  to  N 1 + 1,  throughput  at  all  processors  increases.  The 
reason  for  this  is  obvious  at  the  CPU  and  nearly  so  at  the 
PP's:  More  servers  at  the  CPU  means  more  rapid  return  of 

jobs  to  the  PP's,  resulting  in  a greater  proportion  of  time 
spent  serving  jobs.  Similarly,  the  idleness  probabilities 
at  the  PP's  decrease  and  the  average  occupancies  increase. 
The  result  is  a corresponding  decrease  in  average  occupancy 
and  a resulting  increase  in  idleness  probability  at  the  CPU. 
Note  that  in  each  case  there  is  a point  beyond  which 
increasing  the  number  of  CPU's  (that  is,  the  number  of 
servers  at  the  CPU)  does  not  significantly  improve  the 
system.  For  example,  with  N1  = 7 there  are  no  changes  in 
the  measures  of  effectiveness  (down  to  the  third  significant 
digit)  fcr  the  PP's,  and  little  change  in  those  for  the  CPU, 
as  the  number  of  servers  at  the  CPU  is  increased  beyond 
three.  The  reason  for  this  phenomena  is  that  the  PP's  have 
become  the  bottleneck  at  this  point.  Judging  from  the 
results  given  in  the  three  tables,  increasing  the  number  of 
CPU's  beyond  two  would  probably  not  be  justified  if  the  job 
mixes  given  are  representative  of  those  which  would  be  seen 
by  the  computer  modelled. 
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2.2.  Approximation  by  Local  Balance  Networks 


In  this  subsection  consideration  is  given  to  ways  in 
which  a queuing  network  which  does  not  satisfy  the  local- 
balance  conditions  might  be  approximated  by  one  which  does. 
The  goal  is  to  find  an  approximation  whose  steady-state 
properties  are  vary  nearly  the  same  as  those  of  the  original 
network.  If  such  an  approximation  can  be  found,  much  time 
and  effort  could  be  saved  by  taking  advantage  of  the 
product-form  solution  to  the  approximate  model. 

Cf  particular  interest  is  the  FCFS  model  discussed 
in  section  1.  This  model  does  not  satisfy  the  local-balance 
conditions  because  it  contains  at  least  one  FCFS  gueue  at 
which  jobs  cf  different  types  receive  service  at  different 
rates.  As  can  be  seen  from  subsection  5.3  of  Chapter  I, 
the  work  cf  Baskett,  Chandy,  Muntz  and  Palacios  [6] 
indicates  that  local  oalance  would  prevail  if  the  queuing 
discipline  at  these  queues  were  PS,  IS  or  LCFSPS  rather  than 
FCFS,  or  if  the  processing  rates  were  the  same  for  the  two 
jcb  types  at  each  FCFS  processor.  These  observations  will 
form  the  basis  for  most  of  the  approximations  discussed 
here. 


Reviewing  the  example  of  Baskett,  et.  al.  expanded 
upon  in  subsection  2.1,  it  is  seen  that  replacing  the  FCFS 
CPU  by  either  an  IS  or  a PS  CPU  could  lead  to  significant 
differences  in  the  measures  of  system  performance  (see 
Tables  4.1,  4.2  and  4.3).  The  reason  for  this  is  that  the 
rapidly-mcvirg  type-one  jobs  must  at  times  wait  at  the  FCFS 
CPU  for  the  slew-moving  type-two  jobs  to  complete  service. 

In  the  IS  CPU  there  is  no  interference  between  the  two  types 
of  jobs.  In  the  PS  CPU  there  is  interference  in  the  form  of 
degraded  service,  DUt  the  extreme  difference  in  service 
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rates  makes  this  interference  considerably  less  severe  than 
that  in  the  FCFS  CPU. 

If  the  FCF3  CPU  were  replaced  with  a LCFSP3  CPU  in 
the  same  model,  seme  interference  of  the  type  encountered  in 
the  FCFS  CPU  would  occur.  The  completion  of  service  of  any 
type-one  job  at  the  (LCFSPR)  CPU,  whether  the  type-one  job 
was  enqueued  or  in  service  when  the  type-twc  job  arrived, 
wculd  necessarily  wait  until  the  type-two  jcb  had  completed 
its  service.  However,  the  high  service  rata  of  the  type-one 
jots  at  the  CPU  as  compared  to  their  rates  at  the  PP's  makes 
the  probability  that  the  type-two  job  will  catch  one  or  more 
type-one  jobs  at  the  CPt)  when  it  arrives  rather  small.  On 
the  other  hand,  the  chances  are  good  that  the  type-two  job 
will  be  interrupted  (perhaps,  several  times)  while  at  the 
CPU.  The  anticipated  result  is  an  increase  in  idleness 
prebability  and  a decrease  in  average  occupancy  and 
throughput  at  PP 1 and  the  reverse  of  this  at  PP2 , PP3  and 
PP4.  These  facts  are  easily  seen  to  be  true  since  a careful 
reading  of  [6]  reveals  that  the  idleness  pr cbabilities , 
average  occupancies  and  throughputs  for  this  example  are  the 
same  whether  the  CPU  has  a PS  queuing  discipline  or  a LCFSPR 
queuing  discipline.  That  is,  "PS"  in  Tables  4.1,  4.2  and 
4.3  could  be  replaced  by  "LCFSPR.” 

So  it  is  seen  that  simple  replacement  of  a FCFS 
processor  by  a PS,  IS  or  LCFSPR  processor  with  the  same 
service  distributions  may  result  in  significantly  different 
values  fer  the  measures  of  system  performance.  It  may  be 
possible  to  arrive  at  better  approximations  by  also  changing 
the  service  distributions  (for  example,  by  adjusting  the 
service  rates) . However,  the  types  of  changes  to  make  are 
net  obvious  if  the  queuing  discipline  is  also  changed. 

In  [6]  Haskett,  et . al.  investigated  an 
approximation  to  the  above  model  in  which  the  two  classes  of 
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jots  are  replaced  by  a single  "equivalent"  class  of  jots. 
For  each  value  of  N1  they  retained  the  given  service  rates 
at  the  PP's  and  replaced  the  service  rates  at  the  CPU  ty 

(..2)  r5  = (9,  * ,2>  / <Vr,5  * VV 


and  the  Branching  p robabilities  by 


(4.3) 


= (qp  +gp  )/(g  ♦ q ) 

1 1j  2 2j  1 2 


where  g is  the  rate  at  which  class  i jobs  leave  the  CPU. 
i 

These  rates  are  determined  from  the  solution  of  the  original 

model.  These  choices  for  the  rate  at  the  CPU  and  the 
branching  probabilities  for  the  "equivalent"  class  of  jobs 
are  reasonable  since  they  are  the  values  for  the  parameters 
whicn  would  actually  be  measured. 

Since  the  resulting  network  is  a central-server 

model  with  a single  job  type  and  single- server  exponential 

queues,  the  work  of  Gaver  [38]  applies  (see  subsection  4.2 

of  Chapter  I).  That  is,  the  joint  steady-state  probability 

of  finding  n jobs  at  the  i-th  PP  (where  n ♦ n + n + n 
i 12  3 4 

is  less  than  or  equal  to  the  total  number  of  jobs  in  the 

system)  is  proportional  to  the  product  over  i of  R raised 

i 

to  the  n power  where  S = r p /r  . With  the  choices  of  r 
i i 5 i i 5 

and  p given  in  (4.2)  and  (4.3),  respectively,  R is  the 
i i 

ratio  of  the  utilization  of  the  i-th  PP  to  the  utilization 

of  the  CPU.  This  same  result  generalizes  to  the  less 
specific  FCFS  model  in  which  both  joo  types  are  allowed  to 
visit  each  processor. 
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The  fact  that  the  exact  results  from  each  case  (that 
is,  each  job  mix)  must  be  used  to  derive  the  parameters  for 
the  approximate  model  makes  this  method  of  dubious  value. 

The  exact  model  must  be  solved  (or  measurements  taken  on  the 
system  represented)  in  order  for  the  parameters  of  the 
approximate  model  to  be  determined.  If  the  queuing 
disciplices,  service  rates,  branching  probabilities  or  job 
mix  changes,  these  parameters  must  be  recalculated  from  nen 
measurements.  They  cannot  be  determined  from  the  parameters 
of  the  exact  model  directly. 

Besides  this  Baskett,  et . al.  showed  that 
significant  differences  can  exist  between  the  results  given 
by  the  exact  model  and  those  given  by  the  approximate  model. 
The  author  has  had  similar  experience  in  applying  this 
method  to  a variety  of  two-PP  FCFS  models. 

in  area  which  is  still  open  for  investigation  is 
approximation  of,  for  example,  the  FCFS  model  by  a modei  in 
which  the  branching  probabilities  are  the  same  but  the 
service  rates  for  jobs  of  different  classes  are  replaced  by 
a single  service  rate  at  each  FCFS  queue.  The  work  of 
Baskett,  et . al.  in  [6]  could  then  be  used  to  determine  the 
measures  cf  system  performance  in  the  approximate  model. 
Perhaps,  with  the  aid  cf  the  FCFS  program  an  appropriate 
choice  for  the  composite  service  rates  could  be  determined. 

2.3 . Specif icat ions  f or  large  Jobs 

In  this  final  subsection  attention  is  focused  on  tne 
running  time  and  core  requirements  of  some  large  jobs.  With 
common  values  for  system  parameters  (SI,  N2,  tne  service 
rates  and  the  branching  probabilities)  the  FCFS  model 
results  in  more  states  than  either  of  the  other  two  models. 
The  PS  queuing  discipline  at  the  CPU  in  the  PS  model  and  the 
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multiserver  at  the  CPU  and  infinite  server  at  PP1  in  the 
tapes  model  reduce  the  size  of  the  state  space  from  that 
experienced  in  the  FCFS  model.  In  addition,  despite  the 
fact  that  more  nonzero  entries  are  required  per  row  in  the 
rate  matrix  (COEF)  for  both  the  PS  model  and  the  tapes 
model,  the  reduced  state  spaces  in  these  models  result  in  a 
reduction  in  the  total  number  of  nonzeros  in  large  cases. 

As  a result  the  primary  concern  here  is  the  requirements  of 
the  FCFS  program. 

A FCFS  model  with  four  jobs  of  each  type  (N1  = N2  = 
4)  and  two  PP's  (NEP  = 2)  resulted  in  3150  states  and  10080 
ncnzeros  in  the  rate  matrix.  Dimensioning  the  state 
prcbability  array  (P)  and  the  three  arrays  used  for  storage 
of  the  balance  equations  (NCON,  INDEX  and  COEF)  accordingly, 
the  program  required  164K  bytes  of  storage  on  the  IBM  360-67 
computer  at  the  Naval  Postgraduate  School  in  Monterey, 
California.  The  service  rates  used  in  this  model  were  0.6, 
1.2  and  0.9  for  type-one  jobs  and  0.8,  1.0  and  0.5  for 
type-two  jobs  at  the  CEU,  PP 1 and  PP2 , respectively.  The 
branching  probabilities  were  0.55  and  0.45  for  type-one  jobs 
and  0.30  and  0.70  for  type-two  jobs.  Convergence  was 
attained  (using  the  rather  stringent  criterion  described  in 
section  1)  in  187  Gauss-Seidel  iterations.  The  total 
execution  time  for  the  program  was  212.13  seconds. 

A second  case  using  the  FCFS  model  with  N1  = 2,  N2  = 
5 and  NPP  = 4 resulted  in  6930  states  and  35280  nonzercs  in 
the  rate  matrix.  Dimensioning  P,  NCON,  INDEX  and  COEF 
accordingly,  the  problem  required  396K  bytes  of  storage. 

The  service  rates  used  were  10.0  for  type-one  jobs  and  1.0 
for  type-two  jobs  at  the  CPU  and  the  reverse  of  these  at 
each  peripheral  processor.  Branching  probabilities  were  all 
.25  regardless  of  joo  type  or  PP.  Convergence  was  attained 
in  206  iterations.  Ihe  program  required  527.05  seconds  of 
execution  time. 
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The  PS  model  was  also  run  using  the  parameters  of 
this  seccnd  example.  The  result  was  5754  states  and  30464 
ncnzeros.  The  dimensions  of  the  FCFS  model  (6930  and  35280) 
were  used  in  this  model  and,  because  of  differences  in  the 
programs  themselves,  this  resulted  in  a requirement  for  398K 
bytes  of  storage.  This  figure  could  have  been  reduced  by 
dimensioning  P,  NCON,  INDEX  and  COEF  according  to  actual 
requirements.  Convergence  was  attained  in  just  32 
iterations.  The  program  required  98.63  seconds  of  execution 
time.  The  measures  of  system  performance  reported  in  Table 
4.4  for  these  two  models  again  point  out  tne  extent  of 
possible  error  when  a PS  CPU  is  assumed  to  be  a FCFS  CPU,  or 
visa  versa.  In  this  particular  comparison  type-one  jots  are 
»EF  bound"  and  type-two  jobs  are  "CPU  bound." 

Although  the  number  of  iterations  required  for 
convergence  of  the  Gaass-Seidel  technique  for  solution  of 
the  balance  equations  generally  increases  with  the  number  of 
states,  wide  variation  exists  in  the  number  of  iterations 
required  for  a problem  with  a given  number  of  states. 

Indeed,  the  author  has  examples  of  cases  with  only  30  states 
requiring  more  iterations  than  the  5754-state  case  reported 
in  the  preceding  paragraph.  This  should  not  be  too 
surprising.  As  pointed  out  in  Chapter  III,  the  number  of 
iterations  required  for  convergence  depends  upon  the 
magnitude  of  the  nondominant  eigenvalues  of  the  rate  matrix. 
The  eigenvalues  of  any  matrix  depends  upon  each  and  every 
entry  in  the  matrix.  Changing  a single  value  in  the  matrix 
will,  in  general,  change  all  of  the  eigenvalues.  Thus, 
little  hope  is  seen  for  being  able  to  predict  the  number  of 
iterations  required,  or  the  running  time,  based  upon  the 
system  parameters.  The  running  time  can  be  reduced  by 
relaxing  the  convergence  criterion.  Since  the  real  items  of 
interest  are  the  measures  of  system  performance,  such  as 
idleness  probabilities  and  average  occupancies,  changes  in 
these  quantities  could  ne  used  as  a basis  for  determining 
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TABLE  4.4 

COMPARISON  OF  FCFS  AND  PS  PROGRAMS  IN  A 
CASE  IN  WHICH  NPP  =4,  N1  = 2 AND  N2  = 5 


“ 

FCFS  Program 

PS  Progra 

Number  of  states 

6930 

5754 

Number  cf  nonzeros 
in  rate  matrix 

35280 

30464 

CPU 

idleness  probability 

.000197 

.000920 

PP 

idleness  probability 

.890 

. 696 

CPU 

average  occupancy 

6.438 

5.273 

PP 

average  occupancy 

. 141 

.432 

CPU 

throughput 

1.308 

2.014 

PP 

throughput 

.327 

. 504 

Note  that  performance  at  the  four  FP's  is  the  same.  The 
figures  reported  here  are  for  each  PP. 
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convergence.  Unfortunately,  any  savings  which  might  be 
realized  by  decreasing  the  number  of  iterations  in  this  way 
would  be  diminished  by  the  time  required  to  calculate  these 
measures  at  each  iteration.  In  many  cases  the  result  may  be 
a net  increase  in  running  time. 

Comparisons  of  the  core  requirements  and  running 
time  with  these  required  by  other  possible  solution  methods 
are  difficult  at  best.  None  of  the  examples  presented  here 
were  run  on  a dedicated  machine.  Because  of  the  effects  of 
other  jots  in  the  system,  rerunning  these  same  jobs  would 
likely  result  in  different  execution  times.  Although  the 
author  was  "core  conscious"  in  programming  the  models,  there 
are  probably  still  ways  in  which  core  usage  could  be 
reduced. 


In  general,  the  following  statement  can  be  made.  If 
a product-form  solution  exists,  running  time  is  bound  to  be 
shorter  for  a program  designed  to  take  advantage  of  it.  The 
reason  is  that  no  iterations  are  required,  and  it  is  net 
necessary  to  generate  and  store  the  balance  equations.  Even 
in  such  cases,  however,  some  of  the  concepts  and  techniques 
developed  in  Chapter  II  may  be  helpful  in  generating  all 
states  without  duplications. 
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V.  IHE  SOFT WARE- MONITOR  PROBLEM 


Software  monitors,  or  system  jobs,  are  used  in  most 
large-scale,  multiprogrammed  computer  systems  to  provide 
data  concerning  performance  of  the  system  and  usage  of  the 
system  by  individual  user  jobs.  In  this  chapter  some 
possible  sources  of  bias  in  the  data  provided  by  such 
monitors  are  investigated.  Modelling  the  computer  system  as 
a closed  central-server  system,  two  types  of  software 
monitors  are  examined.  In  each  case  a method  is  presented 
which  will  predict  the  bias  in  the  monitor. 

Consider  a situation  in  which  a central-server  model  is 
developed  for  an  existing  computer  system,  and  a software 
monitor  is  used  to  collect  system-performance  data  in  order 
to  validate  the  model.  The  results  of  this  chapter  could  be 
used  to  explain  differences  between  model  results  and 
monitor  results.  The  question  of  correcting  monitored  data 
for  bias  is  not  addressed  here.  This  remains  an  open 
question  which  has  apparently  not  been  considered  in  the 
open  literature. 


1.  THE  EROBLEM 


One  of  the  major  problems  in  modelling  real  systems  is 
monitoring  the  system  so  as  to  collect  the  data  necessary  to 
estimate  the  parameters  used  in  the  model.  The  same  problem 
arises  in  validation  of  resulting  models  where  system 
performance  must  be  monitored  for  comparison  with  model 
predictions. 
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For  computer  systems  two  types  of  monitors  are  generally 
available.  Hardware  monitors  are  external  devices  which, 
when  attached  to  various  processors,  determine  the  activity 
at  the  processors  by  measuring  passage  of  electrical  current 
and  changes  in  electrical  potential.  Software  monitors  are 
internal  devices,  or  system  programs,  which  use  computer 
processing  capabilities  (CPU  time  and  memory)  to  collect 
data.  Individual  program  accounting  data  (used  as  a basis 
for  charging  system  users)  are  one  class  of  data  collected 
using  software  monitors. 

Software  monitors,  in  using  computer  resources,  somewhat 
degrade  the  resources  available  to  users  of  the  system.  For 
example,  system  programs  require  storage  (often  in  core) , 
degrading  the  amount  of  storage  available  for  very  large 
user  programs.  They  also  require  processing  time  and 
therefore  increase  "turnaround  time"  for  users  programs. 
These  are  usually  not  serious  problems,  and  software 
monitors  are  generally  much  less  expensive  and  more  flexible 
than  hardware  monitors.  This,  plus  the  fact  that  it  is 
extremely  difficult  to  differentiate  between  individual 
programs  with  a hardware  monitor,  makes  the  software 
monitors  the  most  likely  choice  for  data  collection,  whether 
for  accounting  data,  model-parameter  data  or  model- 
validaticn  data. 

In  this  chapter  models  of  two  types  of  software  monitors 
are  discussed.  A possible  source  of  bias  in  the  data 
collected  by  such  monitors  is  analyzed.  Throughout  the 
chapter  the  computer  system  under  consideration  is  modelled 
as  a closed  central-server  network  of  queues  as  pictured  in 
Figure  1.1.  This  model  is  assumed  to  be  an  accurate 
representation  of  the  system,  and  steady-state  probabilities 
(assumed  to  exist)  calculated  from  the  model  are  therefore 
also  assumed  to  be  -accurate.  The  purpose  of  the  software 
monitor  in  each  case  is  to  determine  system  performance  by 
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observing  this  probability  distribution.  A model  of  the 
monitor  is  used  to  determine  the  distribution  "seen"  by  the 
monitor  sc  that  comparison  may  be  made  with  the  "true" 
distribution  and  bias  determined. 

In  section  3 consideration  is  given  to  a monitor  which 
briefly  occupies  the  CPU  and  determines  the  state  of  the 
system  each  time  a job  leaves  the  CPU.  In  section  4 the 
monitor  enters  the  system  infrequently,  waits  for  a free 
server  at  the  CPU,  then  briefly  occupies  the  CPU  and 
determines  the  state  of  the  system.  In  both  sections  the 
problem  is  analyzed  for  a Jackson- type  network  (as  described 
in  section  2)  and  then  extended  to  more  general  cases  such 
as  those  discussed  in  Chapter  II. 

2.  THE  TASIi  MODEL 


The  software-monitor  models  discussed  in  sections  3 and 
4 will  be  analyzed  extensively  in  terms  of  the  closed 
central-server  model  depicted  in  Figure  1.1  with  the 
following  assumptions: 

(i)  Each  queue  is  a single-server,  exponential 
queue  with  constant  service  rate  and  infinite 
capacity. 

(ii)  Only  one  type  of  job  circulates  in  the 
system . 

(iii)  Branching  probabilities  are  constant. 

Under  these  assumptions  the  queuing  network  under 
consideration  is  called  a Jackson  network  (the  term  is 
borrowed  from  Melamed,  Zeigler  and  3eutler  [30])  in  honor  of 
J.  E.  Jackson  [56]  who  first  exnibited  a product-form 
solution  for  the  sceady-state  probanility  distribution  of 
such  models.  Before  examining  this  solution,  consider  the 
balance  equations  which  tne  solution  must  satisfy. 
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The  model  described  here  is  a continuous-time, 
finite-state  Markov  process  which  is  also  irreducible. 

Hence,  the  steady-state  probability  distribution  exists  and 
can  be  determined  by  solving  a set  of  balance  equations 
together  with  a normality  condition.  (See  Feller  [32].) 
Derivation  of  the  balance  equations  through  limiting 
arguments  and  the  Komolgorov  differential  equations  is  a 
standard  exercise  in  such  cases  and  is  therefore  omitted. 
(See  section  3 of  Chapter  I.)  Direct  development  of  the 
balance  equations  will  follow  the  introduction  of  some 
notation. 

Let  N denote  the  total  number  of  jobs  circulating  in  the 

system.  The  M+1  processors  are  numbered  sc  that  processor 

i is  PPi  for  i = 1,  2,  ...,  M and  processor  M + 1 is  the 

CPU.  The  service  rate  at  processor  i is  r and  the 

i 

branching  probability  (from  the  CPU)  to  PPi  is  b . By  the 

i 

Markov-like  assumptions,  a state  A is  completely  specified 

by  a listing  of  the  number  of  jobs  at  each  processor.  Thus, 

A = (n  ,n  ,...,n  ) where  for  each  i = 1,  2,  ...,  M+1,  n 

1 2 M+1  i 

is  the  number  of  jobs  at  processor  i when  the  system  is  in 

state  A.  Note  that  n + n + ...  + n =N.  Also  note 

12  M + 1 

that  every  vector  (n^,n^,...,n  of  nonnegative  integers 
which  sum  to  N represents  a valid  state. 


For  any  state  A = (n  ,n  ,...,n  ),  let  A denote  the 

12  M+1  i j 

state  with  i-th  component  increased  by  one  and  j-th 
component  decreased  by  one;  e.  g.,  A = 

ij 

(n  ,. . . , n + 1 , . . . ,n  — 1 , . . . , n ) if  i k j.  Since  A is  not 
1 i j M+1  ij 
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a valid  state  if  n = 0,  any  statement  containing,  for 
example,  the  probability  of  A will  have  that  probability 

ij 

multiplied  by  p (n  ) where 

j 


(5.  1) 


if  n > 0 
if  n < 0 


so  that  a large  variety  of  special  cases  need  not  be 
considered  to  handle  such  "non-states.  " 


For  each  state  A,  P (A)  will  denote  the  steady-state 
probability  that  the  system  is  in  state  A. 


Let  A = (n  ,n  ,...,n  ) be  any  state.  To  develop  the 

12  M+  1 

balance  equation  associated  with  state  A,  note  that: 

(i)  The  rate  of  transition  out  of  state  A (given 
the  system  is  in  state  A)  is  given  by 


(5.2) 


R (A) 


a+i 

y #>  (n  ) r 
3 3 


(ii)  The  rate  of  transition  from  state  A into 

j/H+1 

state  A (given  n >0  and  the  system  is  in  state 
H + 1 

A ) is  r . 

j,M+1  j 

(iii)  The  rate  of  transition  from  state  A 

H + 1,  j 

into  state  A (given  n >0  and  the  system  is  in 

3 

state  A ) is  t r 

M+1,j  j M+1 

(iv)  The  states  A and  A for  j = 1,  2, 

j,M* 1 M+1 , j 
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M are  the  only  states  from  which  the  system 


can  transition  in  one  step  into  state 
Thus,  the  balance  equation  associated  with 


A. 

state  A is 


(5.3) 


a 

R (A)  P (A)  = 0 (n  ) 5 r P (A  ) 

M+1  “ j j,M+1 

j=1 


♦ 


M 

? b r 
“ i M + 1 

j=1 


n ,)P(A 
3 


J*+1r  j 


) 


Using  Gordon  and  Newell's  [46]  formulation  of  this 
problem,  Gaver  [ 38  ] has  determined  that  the  solution  is 
given  by 


(5.4) 


M 

P(A)  = k TT  gnj 

3-.  3 


where  K is  a constant  which  insures  that  the  appropriate 

normality  condition  is  met  and,  for  j = 1,2,...,M,  q = 

i 

b r /r  . Note  from  (5.4)  that 
3 M*1  j 


(5.5) 

and 

(5.6) 


p (A  . m ) = g P(A) 

],M+1  3 


P (A 


M>1,  j 


P (A)/q 

3 
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3.  THE  EVENT-KEYED  SOFTWARE  MONITOR 


Now  consider  attempting  to  monitor  system  performance  by 
means  of  a software-monitor  job,  hereafter  called  the 
observer,  which  briefly  occupies  the  server  at  the  CPU  each 
time  one  cf  the  other  N jobs  completes  service  at  the  CPU. 
While  at  the  CPU,  the  observer  counts  the  number  of  jots  at 
each  of  the  M + 1 processors.  The  time  it  occupies  the 
server  is  assumed  to  be  exponentially  distributed  with  mean 
e so  small  that  the  disturbance  to  system  operation  is 
minimal.  In  fact,  e will  be  allowed  to  approach  zero  so 
that  the  possibility  of  a change  in  the  state  of  the  system 
while  the  observer  is  cccuping  the  CPU  can  be  ignored.  In 
anticipation  of  the  limiting  operation  assume  that 

M+  1 

(5.7)  1/e  >>  y r 

3 

The  observer  is  not  numbered  among  the  N jobs  in  the  system. 

Note  that  since  the  observer  is  served  at  the  CPU  only 
when  a jcb  completes  service  there  and  routes  to  one  of  the 
PP's,  and  since  no  transition  is  allowed  while  the  observer 
is  at  the  CPU,  the  state  in  which  all  jobs  are  at  the  CPU 
cannot  be  observed  by  the  observer.  For  example,  if  N = 1, 
the  observer  will  always  see  the  CPU  idle.  Hence,  it  is 
clear  that  seme  bias  may  exist  in  the  system  performance  as 
reported  by  the  observer.  The  objective  here  is  to 
determine  this  bias.  Since  no  measures  of  system 
performance  have  been  specified  the  approach  will  be  tc 
determine  a computational  method  for  calculating  the 
steady-state  distribution  seen  by  the  observer  in  terms  of 
the  "actual"  steady-state  distribution  as  specified  in 
(5.4)  . From  these  two  distributions  the  same  measures  of 
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system  performance  may  be  calculated  and  compared. 

3.1.  Analysis 

The  difference  between  the  model  discussed  here  and 
the  one  discussed  in  section  2 is  the  introduction  of  the 
observer.  Corresponding  to  each  state  A of  the  earlier 

* 

model  is  a state  A.  which  has  the  same  distribution  of  the  N 

jobs  among  the  M + 1 processors  but  also  has  the  observer  in 

the  system.  This  can  be  depicted  in  vector  notation  by 

addition  of  an  (M+2)-nd  component  having  value  one  if  the 

observer  is  in  the  system  and  zero  if  not.  That  is,  the 

state  (n  ,n  ,...,n  ) has  n jobs  (exclusive  of  the 

12  H+2  j 

observer)  at  processor  j for  j = 1,2, ...M+1  and  has  a total 

of  n + n jobs  (including  the  observer)  at  the  CPU.  By 
M+1  M + 2 

convention  the  state  name  will  ny  "starred"  if  n =1. 

M+2 

* 

Thus,  if  A = (n  ,n  *...,n  ,0),  then  A = 

12  M+1 

(n  i ,n2  f * * * '%♦  -j ' 1)  ‘ 

Since  the  system  is  different,  the  steady-state 

distribution  determined  in  section  2 will  not  hold. 

(Indeed,  this  new  system  has  twice  as  many  states.)  So, 

consider  the  balance  equations  for  this  new  system.  The 

steady-state  probabilities  are  denoted  by  P indicating  a 

e 

dependence  upon  the  value  of  e. 


Consider  first  an  unstarred  state  A = 

(n  ,n  ,...,n  ,0).  The  rate  of  transition  from  state  A, 

12  M+1 


23o 


R(J>),  is  easily  seen  tc  be  specified  by  (5.2)  and  to  be 
independent  of  e.  The  transitions  described  in  (ii)  are 
still  valid,  but  those  described  in  (iii)  are  not  possible 
since  the  observer  enters  the  system  whenever  a job  leaves 
the  CPU.  However,  a transition  into  state  A occurs  when  the 

* 

observer  leaves  the  system  if  the  system  is  in  state  A . 

Thus,  the  balance  equation  associated  with  A,  to  be  compared 
with  (5.3),  is 


(5.8) 


a<A)P  (A) 
e 


a 

* 

0(n  ) 5 r P (A  ) ♦ P (A  )/e 

M+1  j e j , M ♦ 1 e 

j=1 


* 

New  consider  a starred  state  A = 


(n  ,n  ,...,n  ,1) . Since  the  observer  (and  not  one  of  the 

12  e+i 

N jobs)  is  ir  service  at  the  CPU, 


(5.9) 


fl(A*) 


M 


1/e  + 


2 r 
j=1 


yf  (n  ) 
3 3 


* 

Note  that  R ( A ) does  depend  upon  the  value  of  e.  In  fact, 

* 

by  (5.7)  R ( A ) = 1/e  approximately.  The  transitions 

* 

described  in  (iii)  are  valid  with  A replaced  by  A . Those 


described  in  (ii)  are  similarly  valid  so  long  as  the  A 

j,H+1 

* 

is  replaced  by  A . Thus,  the  balance  equation 

j,h+1 

* 

associated  with  k (compare  again  with  (5.3))  is 
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M 

* * * 

(5.10)  8 (A  ) P (A  ) = 0(n  ) 2 r P (A  . ) 

e M+1  1 e i , M + 1 

j = 1 


♦ 5 b r ja  (n  ) P (A  ) 

- j 11*1  j e a+1,j 

j = 1 


Eefcre  proceeding  further  with  the  analysis, 
consider  its  goal:  to  determine  the  bias  introduced  by  the 
observation  method.  This  is  to  be  done  by  calculating  the 
steady-state  probability  distribution  seen  by  the  observer. 
But  this  distribution  is  the  conditional  steady-state 
probability  distribution  given  that  the  observer  is  being 
served  by  the  CPU.  That  is,  the  desired  result  can  be 
determined  by  finding  a solution  to  (5.8)  and  (5.10)  and 

renormalizing  the  probabilit ies  of  the  starred  states, 

* 

{P  (A  ) } . In  principle,  this  can  be  done  by  applying 
e 

solution  technigues  sucn  as  those  discussed  in  Chapter  III. 
cut  (5.7)  makes  this  a compt uationally  unsatisfying  thing  to 
do.  Alsc,  the  following  analysis  makes  it  unnecessary. 


Multiplying  (5.8)  through  by  e,  notice  that 


(5.11) 


M 

* 

P (A  ) = e[  R ( A)  P (A)  - j3(n  ) ? r P (A 

e e M + 1 ” j e j , 

j = 1 


Since  R(A),  r and  ft  (n  ) are  all  independent  of  e 
j «♦  1 

since  P (A)  and  ? (A  ) are  bounded  above  by  one, 

e e j , 1 

approaches  zero  as  e approaches  zero. 


.1+  1 


) ] 


an  d 


P (A*) 

e 


238 


Now  using  (5.9)  in  (5.10): 


M 

★ * * 

(5.12)  E (A  )/e  = 7 r .[*<n  .P  (A  ) ♦ *(n  Jp  (A  . , ) ] 

€ i j e M+1  e D/S+l 

j=1 

M 

+ y b r 0(n)  P (A  ) 

” j M+1  e M+1,j 

j = 1 

As  a result  cf  (5.11),  it  is  seen  that  (5.12)  leads  to: 

M 

* 

(5.13)  lim  P (A  )/e  = 5 b r jz>(n  )P  (A  ) 

e ~ j M + 1 i 0 M+ 1 , j 

e — >0  j=  1 

Using  this  result  to  determine  the  limit  in  (5.8): 

a 

(5.14)  B(A)P  (A)  = *(n  ) lr  P (A.  ) 

0 M+1  g 0 3 , M + 1 

3=1 


M 

+ 5 b r 0(n)P(A  ) 

" j M+1  j 0 M+ 1 , j 
3 = 1 


Comparing  this  with  (5.3)  note  that  (5.14)  are  the  balance 
equations  for  the  system  described  in  section  2.  These 
results  should  not  be  too  great  a surprise.  They  say  that, 
as  the  mean  time  the  observer  is  in  the  system  approaches 
zero,  the  probability  of  finding  the  observer  in  the  system 
approaches  zero  and  the  probability  of  finding  the  system  in 
a state  which  does  not  include  the  observer  (an  unstarred 
state)  approaches  the  probability  of  finding  the  system  in 
that  state  if  the  observer  does  not  exist.  This  limiting 
distribution  is  given  by  (5.4). 

Now  define  a function  of  the  state  space  of  the 
basic  model  described  in  section  2: 


23S 


(5.15) 


h (A) 


* 

= lim  P (A  )/e 
e 

e — >0 


* 

Note  that  h (A)  = P (A  )/e  + 0(e)  so  that  the  h (A) ' s are  a 

e 

* 

scaled  version  of  the  P (A  ) *s.  That  is,  the  limit  (as  e 

e 


approaches  zero),  of  tne  conditional  distribution  may  be 


found  by  normalizing  the  h(A)'s.  Now  using  (5.13),  (5.6) 

and  (5.2)  yields 


M 

(5.16)  h (A)  * 2 b r 0 (n  ) P (A  ) 

j 9+1  j M+  1 , j 

j=1 


« 

= P(A)  7 b r 0 (n  ) /q 

. , j a+1  3 3 

3=1 


M 

= P (A)  J r > (n  .) 


= P (A)  [H  (A)  - r 0(n  ) ] 

M+1  M+1 


Using  (5.16),  h(A)  can  be  determined  from  the  true 
distribution  (the  P (A) 's)  and  the  system  parameters. 
Normalizing  yields  the  distribution.  The  desired  measures 
of  system  performance  may  then  be  calculated  from  both 
distr ibutio ns  and  the  results  compared.  Note  that  if  A = 


(n  ,n  ,...,n  ) where  a = n = ...  = n =0  and  n = 0, 

1 2 H+1  1 2 U M+2 

then  R ( A)  = r and  h (A)  = 0.  That  is,  this  state  can 

M+1 
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never  be  observed  by  the  observer. 


3.2.  Generalizations 

Consider  an  arbitrary  closed  network  of  M ♦ 1 queues 
and  N jobs  circulating  among  them.  From  among  the  queues 
designate  one  the  CPU  and  the  others  the  PP's.  Sequentially 
number  the  queues  so  that  queue  M + 1 is  the  CPU.  Now 
suppose  that  each  state  of  the  system  may  be  represented  as 
a vector  of  integers  and  that,  so  designated,  a finite 
system  of  balance  equations  may  be  found  which  are  satisfied 
by  the  steady-state  probability  distribution  for  the  states. 
That  is,  assume  that  the  system  is  modelled  as  a finite 
state,  continuous  time  Markov  process.  Examples  of  such 
models  are  found  in  Chapter  II  of  this  thesis  as  well  as  in 
Easkett,  Chandy,  Muntz  and  Palacios  [6]  and  Kelly  [63]. 
Assume  further  that  the  steady-state  distribution  is  known 
(or  can  be  determined)  . 

For  convenience,  also  assume  that  two  or  more  of  the 
following  three  types  of  transitions  may  not  occur 
simultaneously : 

(i)  transitions  resulting  from  one  or  more  jobs 
leaving  the  CPU  destined  for  the  PP's; 

(ii)  transitions  within  the  CPU  (e.g.,  a job 
changing  from  one  stage  of  service  to  another)  ; 

(iii)  transitions  within  and  among  the  PP's  and 
from  the  PP's  to  the  CPU. 

For  each  state  A define  three  subsets  of  the  state  space: 

C ^ ( A)  = {B  in  state  space  | a single  step 

transition  can  take  place  from  B to  A as 

specified  in  (i)} 
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V1' 


{E  in  state  space  | a 
transition  can  take 


single  step 
place  from  B to  A 


as 


specified  in  (ii)  } 

C^(A)  = (E  in  state  space  | a single  step 

transition  can  take  place  from  3 to  A as 
specified  in  (iii) } 

V. 

Because  of  the  assumptions  concerning  occurrence  of 

simultaneous  transitions,  if  a single  step  transition  can 

occur  from  seme  state  B into  state  A,  then  E is  in  exactly 

one  of  C (A)  , C (A)  and  C (A)  . The  balance  equation 
12  3 


associated  with  any  state  A can  be  written  as: 


(5.17)  3 ( A)  P (A)  = 1 r (3,  A)  P (B)  + 2 r(3,A)P(B) 

sec  (A)  aec  (A) 

1 2 

* 2 r (3,  A)  P (B) 

B€C  (A) 

3 

where  P ( A)  is  the  steady-state  probability  that  the  system 
is  in  state  A,  r (B , A)  is  the  rate  of  transition  from  state  B 
to  state  A given  the  system  is  found  in  state  B,  and  R (A)  is 
the  total  rate  of  transition  from  state  A given  the  system 
is  found  in  state  A.  In  analogy  with  (5.2),  R (A)  may  be 
written  as  a sum  of  r (A, 3)  over  all  states  B into  which  the 
system  cculd  transition  from  state  A in  one  step. 

Now  consider  a software  monitor,  again  called  the 
observer,  which  enters  the  system  each  time  a transition 
occurs  in  which  one  or  more  jobs  leave  the  CPU  destined  for 
the  PP's . Again  assume  that  the  service  distribution  for 
the  observer  at  the  CPU  is  exponentially  distributed  with 
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mean  e.  Also  assume  there  is  only  one  observer,  so  that  a 
second  one  cannot  enter  the  system  if  another  transition  as 
described  in  (i)  occurs  while  the  observer  is  at  the  CFO. 
Furthermore,  assume  that  the  observer  cannot  be  preempted, 
cannot  be  blocked,  and  is  subject  to  no  bulking. 


As  in  subsection  3.1,  use  a star  to  denote  presence 

of  the  observer  in  the  system.  Except  that  P (A)  will 

e 

denote  the  steady-state  probability  that  the  system  is  in 

state  A,  the  notation  introduced  earlier  in  this  subsection 

* * 

will  be  adhered  to.  Note  that  r(A  , B)  and  R (A  ) are 

* * * 

dependent  upon  e,  though  r(B,A  ) and  r (B  , A ) are  not. 

+ 

Also,  let  f (A  ) be  the  rate  at  which  the  system  transitions 

* 

out  of  A by  having  the  observer  complete  service  at  the  CPU 


and  leave  the  system  (given  that  the  system  was  in  state 

* * 

A ).  For  many  queuing  disciplines,  f(A  ) = 1/e.  For  the  PS 

* -1 

discipline  f (A  ) = [e(n  •♦■1)]  where  n is  the  number  of 

CPCJ  CPU 

* 

jots  at  the  CPU  in  state  A exclusive  of  the  observer. 

* 

Assume  that  f (A  ) increases  without  bound  as  e approaches 

* 

zero.  Recognizing  that  A may  not  be  a valid  state  for  all 

* * 

unstarred  states  A,  define  ? (A  ) = 0 if  A is  not  valid. 

e 

(For  an  example  of  such  a case,  suppose  the  CPU  is  a single 

server,  rCFS  queue  with  generalized  Erlangian  service 
dis tr ibutions  and  consider  a state  A in  which  the  job  in 
service  at  the  CPU  is  in  its  second  stage  of  service.) 
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The  balance  equations  for  the  system  containing  the 
observer  are  given  by 


* * 

(5.18)  R ( A)  P (A)  = f (A  ) P (A  ) + 2 r(B,A)P  (B) 

e e e 

B€C  (A) 

2 


+ > r (B , A)  P (fi) 

e 

aec^ (A) 


and,  for  all  A such  that  A is  valid, 

* * * 

(5.19)  R (A  ) ? (A  ) = 2 r (B,A  ) P (E) 


B6C  ^ (A  ) 


* * * 

+ 5 r (B  , A ) P (3  ) 

e 

* * 

3 ec  (A  ) 

2 

* * * 

+ 2 r (B  , A ) P (B  ) 

e 

* * 

B ec  (A  ) 

3 


Dividing  (5.18)  by  f (A  ) and  passing  the  limit  as  e 

* 

goes  to  zero,  note  that  ? (A  ) also  goes  to  zero.  Since 

e 

* * 

R (A  ) is  the  sum  of  f (A  ) and  rates  which  are  independent  of 

* * * * 

e,  R (A  ) P (A  ) and  f(A  ) P (A  ) have  the  same  limit  as  e 
e e 

* * * 

approaches  zero.  Since  r(B,A  ) and  r(B  ,A  ) are  independent 
of  e,  this  limit  is  determined  from  (5.19)  to  be: 
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J 


(5.20) 


* * * 
lim  f (A  ) P (A  ) = 2 r (B,  A ) P (B) 

e 0 

€”->0  * 

3€C  (A  ) 


Taking  the  limit  in  (5.13)  and  using  (5.20),  the  result  is 

seen  to  be  the  same  as  (5.17)  sc  that  P (A)  and  P(A)  are  the 

0 

same.  The  reason  this  is  true  is: 

* * 

(i)  If  A is  valid,  3 € C^(A  ) iff  the  system 

* 

transitions  from  B to  A by  a departure  from  the 


CPU.  That  is,  if  there  were  no  observer,  3 would 


be  in  C (A)  . 


(ii)  If  A is  not  valid,  the  system  cannot 


transition  into  A by  a departure  from  the  CPU  even 
if  there  were  no  observer;  i.e.,  C (A)  is  empty. 


Define  a function,  h,  of  the  state  space  of  the  model 
without  the  observer  by: 


(5.21)  h (A)  = 2 r (3 , A)  P (3) 

BCG  ^ (A) 


Note  that  normalizing  the  h(A)'s  yields  tne  distribution 

* 

seen  by  the  observer  if  (and  only  if)  f(A  ) is  constant  for 

* 

given  e as  a function  of  A (such  that  A is  valid) . This  is 

* 

true  in  the  many  cases  in  which  f(A  ) = 1/e,  but  is  not  true 

in  the  case  the  CPU  has  a ps  queuing  descipline.  However, 
in  that  case  the  desired  result  is  obtained  if  (5.21)  is 
replaced  ty: 
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(5.22) 


h (A) 


f 


= (n  +1)  y r (B, A) P (B) 
CPU 

Bee  (A) 

1 


♦ 

since  the  term  involving  e in  H(A  ) 


is  1/[  e (n  +1 ) ]. 
CPU 


* 


that  if  A is  not  valid,  the  sum  in  (5.21)  and  (5.22) 

vacuous  and  h (A)  = 0.  That  is,  such  states  cannot  he 
observed  fcy  the  observer. 


is 


4.  THE  HASTY  AND  INFREQUENT  OBSERVER  SOFTWARE  MONITOR 

Suppose  new  that  system  software  is  monitored  by  means 
of  a software-monitor  job  which  enters  the  system 
infrequently,  waits  for  an  available  server  at  the  CPU, 
briefly  occupies  the  first  available  server,  hastily  counts 
the  number  of  jobs  at  eacn  of  the  M + 1 processors,  and  then 
leaves,  only  to  return  much  later.  This  monitor  job  is 
hereafter  called  the  hasty  and  infrequent  observer,  or  HIO. 
Assume  that  the  service  times  for  the  HIO  are  exponentially 
distributed  with  mean  e and  that  times  between  visits  to  tne 
system  (i.e.,  from  the  time  it  leaves  the  system  until  it 
next  enters  the  system)  are  distributed  exponentially  with 
mean  1/w.  The  bias  is  examined  in  the  limiting  case  tnat  e 
and  w both  approach  zero.  Though  xt  is  not  necessary  to  do 
sc,  the  case  in  which  e/w  = 1 can  be  borne  in  mind.  The 
approach  is  similar  to  that  exhibited  in  section  3. 
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4.1.  Analysis 

Consider  introduction  of  the  HIO  into  the  Jackson 
model  introduced  in  section  2.  As  in  subsection  3.1,  add  a 
component  to  the  state  vector  and  give  it  a value  of  one  if 
the  HIO  is  in  service  at  the  CPU  and  zero  if  the  HIO  is  not 
in  the  system.  In  contrast  to  the  observer  discussed  in 
section  3,  the  HIC  can  be  in  the  system  but  net  in  service. 
This  case  will  be  denoted  by  a two  in  the  (M  + 2)-nd  component 

of  the  vector  . If  A = (n  ,n  ,...,n  ,0)  is  a state,  then 

12  M+1 

* # 

so  is  A = (n  ,n  ,...,n  ,1)  and,  if  n > 0,  so  is  A = 

12  M+1  M+1 

(n,n,...,n  , 2)  . The  notation  A , R (A)  and  0 (n)  will 

1 2 M+1  i, j 

have  the  same  meaning  it  had  in  subsection  3.1.  Again, 

P (A)  will  be  the  steady-state  probability  of  state  A in  the 
e 

system  containing  the  HIO.  P (A)  is  dependent  upon  both  e 

e 

and  w,  even  though  the  notation  does  not  contain  the  w. 


Ccnsider  any  state  A = (n  ,n  ,...,n  ,0).  The 

12  M + 1 

system  may  transition  from  state  A by 

(i)  having  a job  complete  service  at  one  of  the 
PP's  and  route  to  the  CPU;  or 

(ii)  having  a job  complete  service  at  the  CPU  and 
route  tc  cne  cf  the  PP's;  or 

(iii)  having  the  HIO  enter  the  system. 

Thus,  the  total  rate  of  transition  from  state  A,  given  that 
the  system  is  in  state  A,  is: 
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(5.23) 


E (A) 


M+  1 


= y 
j=i 


r .*  (n  .) 
3 j 


♦ w 


* 

In  state  A the  HIO  is  in  service  at  the  CPU.  Thus, 
a transition  ty  (ii)  has  rate  1/e  and  a transition  by  (iii) 
is  impossible.  As  a result,  the  total  (conditional)  rate  of 

* 

transition  ficm  state  A is: 


(5.24) 


* 

a (A  ) 


M 

? r 0 (n  ) + 1/e 


If  n =0  and  the  HIO  enters  the  system,  it 

e + i 

immediately  receives  service  since  the  CPU  is  idle.  Thus, 


* 

if  n = 0,  A is  net  a valid  state.  So,  suppose  that  n 

M+1  M+1 

> 0.  Then,  since  the  HIO  is  in  the  system,  (iii)  dees  not 
apply  ana  the  total  (conditional)  rate  of  transition  from 
# 

state  A is  : 


(5.25) 


# 

R (A  ) 


M + 1 

y r (n  .) 


These  three  equations  should  be  compared  with  (5.2) 
which  gives  the  total  (conditional)  rate  of  transition  from 
state  A if  the  HIO  does  not  exist.  Note  that  as  w 
approaches  zero,  R (A)  from  (5.23)  approaches  the  result  from 

* 

(5.2)  . Also,  ei?(A  ) approaches  one  as  e approaches  zero. 

New  consider  the  balance  equations.  First  consider 
state  A.  Since  the  HIO  enters  the  system  infrequently,  a 
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single  step  transition  into  A may  take  place  from  any  A 

j,M+1 

or  A as  though  the  HIO  did  not  exist.  Thus,  the 

M+1,  j 

balance  equation  associated  with  state  A will  contain  terms 

* 

similar  to  all  of  those  in  (5.3) . However,  from  state  A 

the  system  can  transition  into  state  A by  having  the  HIO 

complete  service  and  leave  the  system.  Thus,  one  term  must 
be  added  and  the  balance  equation  becomes: 


(5.26) 


M 

* 

fi(A)P  (A)  = (1/e)  P (A  ) + 0(n  ) l r P (A  ) 

e e M + 1 j e j , M + 1 

3*i 

a 

+ T'br  0 ( n ) P ( A ) 

~ j M+1  j e a+i,j 

3*i 


* * 

Now  consider  state  A . A transition  into  state  A 

by  having  a *cb  complete  service  at  PP j is  valid  if  n > 0 

M + 1 

* * 

and  must  be  frcm  state  A . A transition  into  A by 

3,  M+1 

having  a ;ob  complete  service  at  the  CPU  is  valid  only  in 


the  case  that  n >0  for  some  j = 1,  2,  ...»  M and  the  job 

j 

which  completed  service  at  the  CPU  was  preventing  the  HIG 

frcm  receiving  service.  That  is,  such  a transition  must  be 

* 

frcm  a state  A such  that  n >0.  Note  also  that  if  the 

H+1,3  j 

HIC  arrives  when  the  system  is  in  state  A,  and  if  n =0, 

M+  1 


249 


the  HIO  will  immediately  enter  service  and  the  system  Hill 

* 

enter  state  A . Hence,  the  balance  equation  associated  with 

* 

A is : 


(5.27) 


* * 
K(A  ) P (A  ) 


a 


= *(n  ) 2 r P A 

M+1  - j e j , M + 1 

j = 1 


+ ? b r 0 (n  ) P (A  ) 

“ j M+1  j e M+ 1 , j 

j = 1 

+ C 1 - 0 (n  ) ]wP  (A) 

M+ 1 e 


finally,  if  a >0,  consider  state  A . A 
M + 1 

# 

transition  intc  state  A by  having  a job  complete  service  at 


IE  j is  valid  if  n >1  and  must  be  from  state  A . The 

M+1  j , M+ 1 

# 

reason  n must  be  at  least  two  is  that  A is  not  a 

M+1  j , M + 1 

state  if  n =1.  (Remember,  the  number  of  jobs  at  the  CPU 
M+1 

t * 

is  one  less  fcr  A than  for  A .)  A transition  intc 

j,M+1 

* 

state  A by  having  a job  complete  service  at  the  CPU  is 
impossible  since  if  the  HIO  is  enqueued  at  the  CPU  prior  to 
such  an  event,  it  would  enter  service.  However,  since  n 

M+1 

# 

> 0,  the  system  enters  state  A if  the  HIO  enters  the  system 
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Thus,  the  balance  equation 


when  the  system  is  in  state  A. 

# 

associated  with  state  A is: 


M 

* # # 

(5.28)  R (A  ) P (A  ) = 0(n  ^1)  5 r P (A  ) + wP  (A) 

e M+1  ” j e j,M  + 1 e 

j=1 


As  in  section  3,  the  distribution  seen  by  the  HIO  is 
conditional  upon  the  HIO  receiving  service  at  the  CPU  and, 
therefore,  is  determined  by  renormalizing  the  probabilities 
associated  with  the  starred  states.  Hence,  the  final  result 

* 

cannot  change  if,  instead  of  the  P (A  )'s,  seme  multiple  of 

e 


them  is  considered.  For  each  state  A of  the  system  without 


the  HIO  (i.e.,  the  system  considered  in  section  2)  , define: 


(5.29)  h (A)  = P (A  ) / (e  w) 

e e 


If  the  value  of  h (A)  can  be  determined  for  each  such  A,  a 

e 

renormalization  will  yield  the  sought-after  distribution. 


It  will  also  be  convenient  to  define: 


# 

(5.30)  g (A)  = P (A  )/w 

e e 


for  each  state  A = (n  ,n  ,...,n  ) such  that  n > C. 

12  H+1  M+1 


Note  that  since  P (A)  is  a probability,  it  is 

e 

bounded  as  w and  e both  approaca  zero.  Substituting  (5.30) 


into  (5.28)  and  dividing  through  by  w yields: 
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(5.31) 


« 

R (A  ) g (A)  = 0(n  -1) 

e 3+1 


3 


2 

j=i 


r .g 

J e 


(A  • J 
3/M+1 


♦ P (A) 
e 


for  each  state  A = (n  ,n  ,...,n  ) such  that  n >0. 

1 2 3+1  3+1 

Using  the  principle  of  aathematical  induction,  g (A)  is  now 

e 

shewn  to  be  bounded  for  each  such  A as  w and  e both  approach 


zero.  First  consider  a state  A such  that  n =1.  Then, 

3+1 

* # 

(5.31)  reduces  to  R(A  )g  (A)  = P (A).  Since  R (A  ) is 

e e 


constant  with  respect  to  w and  e (see  (5.25))  and  P (A)  is 


bounded,  g (A)  must  be  bounded  as  w and  a both  approach 
e 


zero.  Now  suppose  that  k is  any  positive  integer  less  than 


N and  that  g (E)  is  known  to  be  bounded  for  every  state  B 
e 


with  k or  fewer  jots  at  the  CPU.  Let  A be  any  state  such 


that  n = k + 1.  Then  for  each  j = 1,  2,  ...,  3, 
3+  1 


g (A  ) is  bounded  as  w and  e both  approach  zero  since 

e j , 3+  1 


there  are  k jobs  at  the  CPU  in  each  such  state.  Since 


* 

H(A  ) , 0 (n  -1)  and  r are  independent  of  w and  e,  and 
3+1  j 


since  P (A)  is  bounded,  (5.31)  says  that  g (A)  is  bounded  as 
e e 

w and  e both  approach  zero. 


Now  by  substituting  (5.29)  and  (5.30)  into  (5.27) 
and  dividing  through  by  w,  it  is  seen  that: 
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fl 


(5.32)  efi  (A  ) h (A)  = e0(n  ) 5 r h (A  ) 

e M + 1 j e j,M+1 

3=1 


♦ 2 b _r  0 (n  .)  g (A  ) 

j M + 1 j e M+ 1 , g 

3 = 1 

♦ C 1 - *<n  ) ]P  (A) 

M + 1 e 


Since  eR(A  ) approaches  one  as  e approaches  zero,  an 

inductive  argument  similar  to  that  used  in  the  last 

paragraph  shews  that  h (A)  is  bounded  as  w and  e approach 

e 

zero  together. 

Substituting  (5.29)  into  (5.26)  yields: 


(5.33)  H ( A)  P (A)  = wh  (A)  + 0 (n  ) 7 r P (A  ) 

e e H + 1 j e j , M + 1 

3 = 1 


♦ 5 b r 0 (n  ) P (A  ) 

j M+1  j e M+1,j 


Since  h (A)  is  bounded  as  w and  e approach  zero,  the  first 

9 

term  on  the  right  side  of  (5.33)  vanishes  as  the  limit  is 

taken,  aDd  in  the  limit  (5.33)  is  identical  to  (5.3).  That 

is,  in  the  limit  P (A)  approaches  the  ?(A)  in  (5.4).  Since 

e 

h (A)  and  g (A)  are  bounded,  (5.29)  and  (5.30)  indicate 
e e 

* i 

that  P (A  ) and  P (A  ) both  approach  zero  with  w and  e.  So 
e e 

again  it  is  seen  that  as  the  time  between  observations 
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becomes  longer  and  the  duration  of  the  observations  become 
shorter,  the  probability  of  finding  the  HIO  in  the  system 
decreases  toward  zero,  and  the  probability  of  finding  the 
system  in  a given  stare  wnich  does  not  include  the  HIO  tends 
toward  the  probability  of  finding  the  system  in  that  state 
if  the  HIC  dees  not  exist. 


Since  the  limit  of  P (A)  as  w and  e approach  zero  is 

e 

now  known  tc  exist  (it  is  equal  to  P(A)),  the  same  inductive 

arguments  used  above  to  show  that  g (A)  and  h (A)  are 

e e 

bounded  show  that,  for  each  state  A = (n  ,n  ,...,n  ) , h ( A) 

1 2 M ♦ 1 

exists  and,  if  n >0,  g(A)  exists  where: 

H + 1 


(5.34)  h ( A)  = lim  h (A) 

e 

e , w — >0 

(5.35)  g(A)  = lim  g (A) 

e 

e , w — >0 


Furthermore,  the  values  of  these  limits  may  be  determined  in 
terms  of  the  P (A) 's  and  the  system  parameters  by  first 
recursively  solving  for  the  g (A)  's  using  the  limiting  form 
of  (5.31): 


(5.36)  R (A  ) g (A)  = fi  (n  -1)  5 r g (A  ) + P (A) 

:i*i  j j,s+i 

3=1 


and  then  solving  fer  the  h(A)'s  using  the  limiting  form  of 
(5.32)  : 
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a 

(5.37)  h(A)  = lb  r 0 (n  ,)  g (A  .) 

3 M+ 1 3 M + 1 ,3 

j=l 

♦ C 1 - 0(a  ) ]P(A) 

M+1 

The  distrituticn  seen  by  the  HIO  may  now  be  determined  by 
normalizing  the  h(A)  's.  Note  that  h(A)  = 0 if  all  of  the 
jobs  are  at  the  CPU  in  state  A.  The  necessary  calculations 
may  now  be  specified  in  the  form  of  an  algorithm: 

Algorithm  for 

Calculating  the  Steady-State  Distribution 
Seen  by  the  HIO 

(i)  Using  (5.4)  with  K = 1,  calculate  P (A)  for 

each  state  A = (n  ,n  ,...,n  ) such  that  n = 

12  M+1  M+1 

0.  let  m = 0 . (The  value  of  m is  the  number  of 

jobs  at  the  CPU  in  the  states.  A,  for  which  h(A) 
is  beinc  calculated.) 

(ii)  Using  (5.4)  with  K = 1,  calculate  P (A)  for 

each  state  A - (n  ,n  ,...,n  ) such  that  n = 

1 2 M+1  M+1 

m + 1 . 

(iii)  Using  (5.36),  calculate  g (A)  for  each  state 

A = (n  ,n  ,...,n  ) such  that  n = m + 1.  Note 

12  M+1  M+1 

# 

that  the  value  of  R ( A ) should  oe  calculated  from 
(5.25) . 

(iv)  Using  (5.37),  calculate  h(A)  for  each  state  A 

= (n  ,n  ,...,n  ) such  that  n = m. 

1 2 M+1  M+1 

(v)  Increase  m by  1.  If  m < N,  go  to  (ii)  . 

Otherwise,  set  h(A)  = 0 where  A = (0 , 0 , . . . , 0 , N)  . 

(vi)  Set  S egual  to  the  sum  of  the  P(A)'s  and  S 

P h 
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equal  tc  the  sum  of  the  h (A) 's.  For  each  state  A, 

P (A) /S  is  the  true  steady-state  probability  of 
F 

finding  the  system  in  state  A,  and  h(A)/S  is  the 

h 

steady-state  probability  that  the  HIO  finds  the 
system  in  state  A.  STOP. 


4.2.  Generalizations 

In  the  case  of  the  event-keyed  observer  of  section 
3,  the  cause  cf  bias  was  the  fact  that  the  observer  always 
received  service  immediately  after  a job  had  routed  frcm  the 
CPU  to  the  PE's.  In  the  case  of  the  KIO,  this  is  not  always 
true,  although  it  is  true  in  every  case  where  the  number  of 
jots  at  the  CPU  is  no  smaller  than  the  number  of  servers 
there  when  the  HIO  arrives.  That  is,  if  the  number  of 
servers  at  the  CPU  does  not  exceed  the  number  of  jobs  in  the 
system  (and  if  the  CPU  does  not  have  a PS  queuing 
discipline) , the  HIO  cannot  observe  any  state  in  which  all 
of  the  jets  in  the  system  are  at  the  CPU.  In  addition,  bias 
will  be  introduced  if,  in  some  cases,  the  HIO  must  wait 
before  receiving  service.  This  is  true  even  in  the  limit  as 
the  time  between  visits  gets  large  and  the  duration  of  a 
service  interval  gets  small.  The  reason  is  that  the  amount 
of  time  the  HIC  must  wait  (and  thus  the  number  of 
transitions  which  could  occur  in  that  time)  is  independent 
of  the  time  between  visits  and  the  service  time.  Note  that 
if  the  CPU  has  an  IS  or  a PS  queuing  discipline,  then  no 
bias  exists  (in  the  limit)  since  the  HIO  always  receives 
immediate  service. 


Generalization  of  the  form  of  the  network  by 
allowing  jobs  to  meve  from  one  PP  to  another  without  first 
receiving  service  at  the  CPU  complicates  the  problem. 
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Rather  than  solving  for  the  g (A)  's  recursively  as  was  done 
in  the  predeaing  subsection,  it  is  necessary  to  solve  a 
series  of  systems  of  linear  equations. 

Finite  capacity  at  the  CPU  raises  guestions 
concerning  the  possibility  of  the  HIO  not  being  allowed  to 
enter  the  system.  It  must  also  be  assumed  that  the  HIO  is 
not  subject  to  bulking  restrictions  and  that  the  HIO  cannot 
be  preempted. 


Generalization  of  the  number  of  job  types, 
number  of  servers,  of  queuing  discipline  (except  a 
restricted  in  the  preceding  paragraph)  and  of  serv 
distributions  (to  generalized  Erlangian  distributi 
all  be  handled  in  an  analysis  similar  to  that  of  t 
preceding  subsection  with  appropriate  changes  to  t 
equations.  Details  of  these  generalizations  will 
discussed  here  since  the  analysis  is,  in  most  case 
without  beinc  instructive.  In  each  case  the  balan 
equations  must  be  generated  and  it  must  be  assumed 
solution  is  known  for  the  case  in  which  the  HIO  do 
exist.  The  distribution  seen  by  the  HIO  is  then  f 
solving  in  seme  recursive  manner  for  the  g(A)'s,  u 
to  get  the  h(A)'s,  and  normalizing  the  h(A)'s. 
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VI.  THE  CENTRAL-SERVER  MODEL  AS  A SUBMODEL 


In  previous  chapters  ways  in  which  the  equilibrium 
distribution  can  be  determined  for  a wide  variety  of 
central-server  models  have  been  discussed.  Many  potential 
applications  of  this  technology  can  be  modelled  as  a network 
of  queues  having  a central-server  model  as  a major 
subsystem.  Sections  3 and  4 of  this  chapter  present  two 
examples  cf  this  situation.  In  both  sections  the 
central-server  submodel  represents  a computer  and  the 
remainder  of  the  system  is  "external  to  core." 

In  order  to  be  able  to  apply  the  techniques  of  Chapters 
II  and  III,  certain  assumptions  must  be  made  concerning  the 
relationship  between  the  subsystem  and  the  remainder  of  the 
model.  These  assumptions  are  embodied  in  the  concepts  of 
decomposition  and  aggregation  as  discussed  by  Courtois  [27]. 
These  concepts  are  introduced  in  section  1.  Some  details 
concerning  their  application  to  models  having  central- server 
submodels  are  presented  in  section  2. 

1.  DECOMPOSITION  AND  AGGREGATION 

Consider  the  class  of  models  having  the  general  form 

pictured  in  Figure  6.1,  wnere  box  A represents  the  portion 

of  the  queuing  network  external  to  the  central-server 

submodel.  Tie  first  subscript  on  each  a , b and  c 

ij  ij  ij 

refers  to  a job  type  and  the  second  subscript  to  the 
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Figure  6.1- -General  Network  of  Queues  with  a Central-Server  Submodel 


processor  number.  The  a are  the  branching  probabilities 

ij 

of  the  central-server  submodel.  Thus,  for  each  job  type  i. 


For  each  i and  j,  b is  the  probability  that  a type-i  job 

ij 

will  remain  within  the  central-server  subsystem  after 
completion  of  service  at  processor  j,  and  c is  tne 

ij 

probability  that  it  will  leave  the  subsystem.  Thus,  b + 

ij 

c =1  for  each  i and  j. 

i j 

So  that  use  may  be  made  of  the  steady-state  probability 
distribution  for  the  central-server  model,  it  is  assumed 
that  b >>  c for  each  job  type  i and  each  gueue  number  j 

i j ij 

= 1,  2,  ...»  K+1.  This  assumption  allows  use  of  the  ideas 

of  decomposition  and  aggregation  as  discussed  by  Courtois 
[27].  According  to  Courtois,  a system  is  decomposible  f: 
i(i)  interactions  within  groups  can  be  studied  as 
if  interactions  among  groups  did  not  exist,  and 
(ii)  interactions  among  groups  can  be  studied 
without  reference  to  within  group  interactions. 

In  the  context  of  Figure  6.1  this  means  that  interactions 
between  the  central-server  submodel  and  the  remainder  of  the 
gueuing  network  (box  A)  are  so  infrequent,  as  compared  to 
those  within  the  submodel,  that  the  submodel  is  able  to 
"reach  equilibrium"  between  successive  interactions  with  the 
remainder  of  the  network.  As  a result  the  steady-state 
distr ibutions  may  be  determined  for  the  central-server 
submodel.  Figure  6.2,  and,  then,  used  to  determine  the 
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Figure  6 . 2 - -Central -Server  Submodel 


from  General  Network 
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properties  of  an  aggregate  queue,  C,  for  use  in  studying  the 
entire  model  with  the  central-server  submodel  replaced  by 
the  aggregate  queue.  Figure  6.3.  A similar  technique  is 
used  by  Chandy,  Herzog  and  Woo  [21]  in  their  application  of 
Norton's  theorem.  In  practical  terms  the  assumption  that 

b >>  c for  all  i and  j is  equivalent  to  an  assumption 

ij  ij 

that  jobs  visit  the  CPU  (queue  M + 1)  many  times  before 
departing  from  the  subsystem. 

Actual  i aplementation  of  the  method  outlined  above 
would,  in  general,  involve  sufficient  assumptions  concerning 
the  queues  to  allow  use  of  a product-form  solution,  ala 
Baskett,  et.  al.  [6],  or  numerical  techniques  such  as  those 
discussed  in  Chapters  II  and  III.  In  particular,  so  that 
tae  model  in  figure  6.3  can  be  analyzed,  a form  of  service 
distribution  must  be  assumed  for  the  aggregate  queue  C.  For 
simplicity,  service  distributions  at  C are  assumed  to  be 
exponential  with  state-dependent  rates. 

Section  2 examines  more  closely  the  assumed  form  of  the 
aggregate  queue  C and  indicates  how  to  determine  the  rates 
from  the  steady-state  solution  of  the  central-server  model. 
Figure  6.2.  Sections  3 and  4 contain  examples  of  situations 
in  which  this  technique  could  be  applied  in  models  of 
multaprograomed  computer  systems.  Section  3 examines  a 
model  in  which  tne  tape-mounting  process  is  considered. 
Section  4 considers  models  of  core  allocation  to  jobs  as 
they  enter  core  from  the  input  queue. 
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2.  AGGREGATION  OF  THE  CENTRAL-SERVER  MODEL 


Consider  the  problem  of  replacing  the  central-server 
submodel  in  Eigure  6.1  by  a single  aggregate  queue,  C.  In 
order  to  analyze  the  resulting  model,  as  depicted  in  Figure 
6.3,  the  properties  of  this  aggregate  queue  must  be  either 
known  or  assumed.  It  is  assumed  that  all  service 
distributions  at  queue  C are  exponential,  though  the  service 
rates  may  be  state-dependent.  In  this  section  these  rates 
are  determined  under  the  assumption  that  interactions 
between  the  aggregate  queue  and  the  remainder  of  the  network 
are  infreguent  enough  that  equilibrium  is  reached  within 
queue  C between  pairs  of  such  interactions.  A "conditioning 
- unconditiccing"  approach  similar  to  that  often  used  in 
renewal  theory  is  used  here. 

Notice  from  Figure  6.1  that  any  job  circulating  among 
the  queues  of  the  central-server  submodel  could  be  the  next 
job  to  emerge  from  the  submodel  and  enter  the  remainder  of 
the  network  (box  A).  Thus,  the  queuing  discipline  assumed 
for  queue  C aust  reflect  this  property.  In  their 
applications  of  Norton's  theorem  to  networks  of  queues, 
Chandy,  Herzog,  and  Woo  [21]  make  the  aggregate  queue  an 
infinite  server  queue  and  "dispense"  the  total  service  rata 
among  all  of  the  jobs  at  the  queue.  A similar  approach  is 
taken  here,  except  that  the  infinite  server  assumption  is 
misleading  since  box  A may  may  contain  a queue  for  C.  This 
is  the  case  in  the  models  discussed  in  sections  3 and  4 
where  the  central- server  submodel  represents  a computer. 

The  number  of  jobs  "in  the  computer"  is  constrained  by  the 
amount  of  core  and  other  resources  available.  C is 
therefore  pictured  as  a multiserver  queue  in  which  the 
number  of  servers  is  state-dependent. 

Since  the  discussion  involves  both  the  model  depicted  in 
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figure  6.3,  hereafter  called  the  overall  model,  and  the 
central-server  model  depicted  in  Figure  6.2  concurrently,  it 
is  convenient  to  have  notation  which  distinguishes  between 
the  two  mcdels.  Denote  by  W the  state  space  of  the  model 
depicted  in  figure  6.3.  Consider  any  state  S in  W . A 
specification  of  the  number  jobs  of  each  type  in  service  at 
queue  C must  be  included  as  a part  of  any  description  cf 
state  S.  Because  of  the  assumptions  concerning  the  queuing 
discipline  and  service  distributions  at  C,  nc  further 
information  concerning  the  contents  of  queue  C is  required 
for  a description  of  state  S,  though  additional  information 
may  be  reguired  to  specify  the  waiting  line  for  entry  to  C. 
As  seen  in  Chapter  II,  changing  the  composition  of  jobs  in  a 
central-server  model  (that  is,  changing  the  number  cf  jobs 
of  one  or  mere  job  types)  changes  the  state  space.  This  is 
true  even  if  the  total  number  of  jobs  does  not  change. 

Denote  the  state  space  of  the  central-server  model  depicted 
in  Figure  6.2  by  Q (S)  when  the  overall  model  is  in  state  S. 
Since  the  composition  of  jobs  at  C is  specified  by  a 
description  cf  S,  the  dependence  of  the  state  space  cf  the 
central- server  model  upon  this  compqsition  cf  jobs  is 
expressed  as  a dependence  upon  the  state  3.  Note  that  it  is 

possible  that  Q(S  ) = C(S  ) for  S * S , noth  in  H. 

1 2 12 

Now  let  S be  any  element  of  W.  The  service  rate  at  the 
aggregate  queue  C for  jobs  of  each  type  is  determined  by 
conditioning  upon  the  state  (from  Q < S) ) of  the 
central-server  model  represented  by  C,  and  then 
unconditicnirg  by  using  the  steady-state  probabilities  for 
the  central-server  model.  Note  that  the  result  is  still 
conditional  upon  the  overall  system  being  in  state  S.  That 
is,  the  service  rates  at  c are  state-dependent. 

Let  the  composition  of  jobs  in  the  central-server  lodel. 
Figure  6.2,  be  that  specified  in  a description  of  state  S as 
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the  composition  of  jobs  in  aggregate  queue  C.  Then  the 

state  space  for  the  central- server  model  is  Q (S)  . Also 

assume  that  the  steady-state  distribution  has  been 

determined,  maybe  by  using  the  techniques  discussed  in 

Chapter  II  cr  by  using  a product  form  solution.  For  each  A 

in  Q (S)  , let  P (A)  denote  the  steady-state  probability  that 
S 

the  central-server  system  is  found  in  state  A. 


Let  A be  any  state  in  Q(S).  From  a description  of  A and 
a specification  of  the  parameters,  service  distributions, 
queuing  disciplines,  and  so  forth  for  the  central-server 
model,  the  rate,  r , at  which  the  system  leaves  staT.e  A by 

ij 

having  a type-i  jot  complete  service  at  queue  j for  each  job 


type  i and  each  queue  j = 1,  2,  ...,  M + 1 (given  that  the 
system  is  in  state  A)  can  be  determined.  The  following 
example  illustrates  how  r would  be  calculated  in  a variety 

ij 


of  situations. 


Example  6 . 1 

Suppose  PP 1 contains  two  type-one  jobs  and  three  type- 

two  jobs  in  state  A.  Furthermore,  in  the  cases  in  which  it 

is  a factor,  the  type-two  jobs  are  known  to  have  all  arrived 

prior  to  the  type-cne  jobs.  (If  it  is  a factor,  this 

information  would  be  contained  in  the  state  description  for 

state  A.)  Suppose  that  all  service  distributions  at  PP1  are 

exponential  with  service  rate  v for  type-i  jobs. 

i 

(a)  If  E E 1 has  a FCFS  discipline  and  m servers. 


then  r = 0 

and  r 

= IV 

if 

m < 3,  but  r = 

1 1 

21 

2 

1 1 

v ^min  (2  ,m -3) 

and  r 

21 

= 3 v 

2 

if 

m > 3 . 
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(b)  If  EE  1 has  a preemptive  LCFS  discipline  and  m 

servers,  then  r = mv  and  r = 0 if  m < 2,  but 
11  1 21 

r = 2v  and  r = v min(3,m-2)  if  m > 2. 

11  1 21  2 

(c)  If  EP 1 has  a preemptive  priority  discipline 
and  m servers,  the  results  of  (a)  apply  if 
type-twc  jobs  have  priority  over  type-cne  jobs, 
but  the  results  of  (b)  apply  if  type-one  jobs  have 
priority  over  type-two  jobs. 

(d)  If  EP 1 has  a PS  discipline,  then  r = 2v  /5 

11  1 

and  r = 3v  /5. 

21  2 

(e)  If  the  CPU  has  finite  capacity  and  can  accept 

no  further  jobs  until  a job  leaves,  then  r and 

11 

r are  as  specified  in  (a)  - (d)  with  m replaced 

21 

by  m-k  where  k is  the  number  of  blocked  servers  at 

queue  1.  In  particular,  if  k = a,  r =0=r 

1 1 21 

New  suppose  that  the  service  distributions  at  PP1  are 

generalized  Erlangian  and  let  v be  the  service  rate  in  the 

ik 

k-th  stage  and  g the  probability  of  departing  the  queue 
ik 

after  completing  service  at  the  k-th  stage  for  type-i  jobs. 

(f)  If  EF1  has  a single  server  and  a FCFS  queuing 

discipline,  then  r =0  and  r = g v if  the 

11  21  2k  2k 

(type-twc)  job  in  service  is  the  k-th  stage  of 
service . 

Now  returning  to  Figure  6.1,  notice  that,  if  the 
central-server  subsystem  transitions  from  state  A by  having 
a type-i  job  leave  queue  j,  then  the  probability  that  that 
jcb  will  leave  the  sunsystem  (at  that  time)  is  c . Thus, 

ij 
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r c is  the  rate  at  wnich  type-i  jobs  complete  service  at 

ij  ij 

queue  j and  depart  the  central-server  subsystem  given  that 

the  subsystem  was  in  state  A.  From  this  it  is  seen  that, 

for  each  job  type  i,  the  rate,  R (A) , at  which  type-i  lobs 

i 

depart  the  subsystem  given  that  the  subsystem  is  in  state  A 
is  given  ty: 

M+1 

(6.1)  R (A)  = J r c 

i ~ ij  ij 

1=1 

Note  that  although  the  values  of  the  r are  also 

ij 

conditional  upon  the  central-server  subsystem  being  in  state 
A,  this  condition  has  been  suppressed  in  our  notation. 

Using  the  steady-state  probability  distribution  for  the 

central-server  model  with  state  space  Q(S),  the  condition  on 

state  A may  new  he  removed  to  determine  the  rate,  T (S) , at 

i 

which  the  overall  system  transitions  from  state  S by  having 

a type-i  job  leave  the  aggregate  queue  C given  that  the 
system  is  in  state  S: 

(6.2)  T (S)  = ? R (A)  P (A) 

i “is 

A €Q  (S) 

At  this  pcint  more  precision  is  possible  in  specifying  the 
character  of  the  aggregate  queue  C.  C is  a multiserver 
queue  with  exponential  service  distributions.  Both  the 
number  of  servers  and  the  service  rates  are  state-dependent. 
If  the  overall  system  is  in  state  S (an  element  of  W) , and 
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if  n is  the  number  of  type-i  jobs  at  C in  state  S,  then  the 
i 

service  rate  for  each  type-i  job  at  C is  T (S)/n  if  n >0 

i i i 

(and  is  immaterial  if  n = 0) . Furthermore,  if  n is  the 

i 

total  number  cf  jobs  at  C in  state  A,  then  n is  also  the 
number  of  servers  at  C,  given  the  system  is  in  state  S. 

In  truth,  the  exact  character  of  C is  usually 

urimportant  since  the  goal  is  examination  of  the  system 

represented  in  Figure  6. 1 by  studying  the  balance  eguations 

(or  the  Kcaclgcrov  differential  eguations)  for  the  overall 

system  as  represen  in  Figure  6.3.  For  these  equations, 

only  the  I (S)  are  required, 
i 

Computationally  it  is  generally  unnecessary  to  solve  the 

appropriate  central-server  model  each  time  a new  state  from 

H is  considered.  Typically  many  states  from  N will  have  the 

same  composition  of  jobs  at  C.  Hence,  the  procedure  to 

follow  is:  First,  for  each  feasible  composition  of  jobs  at 

C,  solve  the  corresponding  central-server  model  foe  the 

steady-state  probability  distribution.  Use  this 

distribution  in  (6.2)  to  calculate  X (S)  for  each  job  type 

i 

i,  and  store  the  T (S) . Then,  in  developing  the  balance 

i 

equations  for  the  overall  model,  use  (for  each  S in  W)  the 

T (S)  corresponding  to  the  composition  of  jobs  at  C 
i 

appropriate  for  the  state  S under  consideration.  Storage  of 

the  T (S)  for  efficient  recall  is  aided  by  the  fact  that  the 
i 

composition  cf  jobs  at  C can  be  represented  as  a vector 

(n  ,n  ,...,n  ) of  nonnegative  integers,  where,  for  each  i = 
12k 

1,  2,  ...»  k,  n is  the  number  of  type-i  jobs  at  C in  the 
i 
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composition  under  consideration,  and  the  number  of  job  types 

is  k.  The  procedures  of  section  3 of  Chapter  II  can  be  used 

to  sequence  the  vectors  representing  feasible  compositions. 

The  T (S)  may  be  stored  in  an  array  T such  that  T(i,j)  is 
i 

T (S)  for  the  j-th  composition.  For  each  state  S,  it  would 
i 

then  be  necessary  only  to  determine  the  sequence  number  j 
corresponding  to  the  composition  of  jobs  at  C specified  in 
the  vector  description  of  S.  Procedures  for  doing  this  are 
also  specified  in  section  3 of  Chapter  II. 


3.  THE  TAPE-MOUNT  PROBLEM 


In  acst  modern  computer  centers  users  are  able  to  retain 
and  use  privately  owned  storage  space,  data  sets  and  program 
libraries  on  magnetic  tapes  and  disk  packs.  Each  job 
requiring  use  of  such  a device  must  wait  for  the  appropriate 
number  of  tape  drives  and  disk  drives  to  oe  allocated  and 
for  the  tapes  and  disks  to  be  mounted  before  core  can  be 
allocated  for  it.  The  physical  operation  of  mounting  the 
tapes  and  disk  packs  is  performed  by  computer  operators. 
Because  of  the  high  speed  with  which  computers  are  able  to 
handle  most  jobs,  and  because  the  computer  operators  have 
many  other  duties,  the  time  required  to  mount  a tape  or  disk 
after  the  drive  has  been  allocated  is  often  many  times  the 
time  required  for  the  computer  to  service  a single  job.  As 
a result  the  computer  could  become  severely  underutilized 
if,  during  seme  period  of  time,  most  jobs  require  such 
mounts.  This  is  the  tape-mount  problem.  In  this  section 
only  tapes  are  considered  explicitly.  Private  disk  packs 
could  be  handled  the  same  way  or  could  be  lumped  together 
with  tapes  as  a single  type  of  resource. 


270 


In  an  effort  to  examine  the  tape  mount  problem 
consideration  is  given  to  the  model  depicted  in  Figure  6.4. 
(Figure  6.4  should  be  compared  with  Figure  6.3.)  Two  types 
of  jobs  transit  through  the  system.  Type-one  jobs  require 
nc  mounts,  but  type-two  jobs  do.  The  box  marked  TM 
represents  the  tape  mounting  procedure;  Q ^ is  the  line  of 

jobs  waiting  for  drives  to  be  allocated  or  tapes  to  be 

mounted.  C represents  the  computer  itself  and  is  an 
aggregate  queue  representing  a central-server  submodel  (see 
Figure  6.1).  is  the  "core-allocation  queue"  where  jobs 

await  servicing  by  the  CPU . All  mounts  have  been  performed 

for  type-two  jobs  in  Q . 


The  jobs  at  C have  been  allocated  core  and  are  currently 

being  serviced  by  the  computer.  The  maximum  number  of  jobs 

at  C may  be  restricted  to  be  the  maximum  attainable  level  of 

multiprogramming  for  the  computer  under  consideration  (or 

seme  average  level  of  multiprogramming) , or  the  ideas 

discussed  in  the  next  section  may  be  utilized  here  to  also 

model  the  core-allocation  procedure.  For  the  present 

discussion -assume  that  there  is  some  maximum  number,  N,  of 

jobs  which  can  simultaneously  be  at  C,  and  that  no 

combination  cf  N jobs  is  restricted  because  of  core 

allocation.  (Note  that  there  may  be  a restriction  if  the 

facility  does  not  have  a sufficient  number  of  tape  drives  to 

allow  N type-two  jobs  in  the  system  simultaneously,  but  this 

restriction  is  not  because  of  core  allocation.)  Also  assume 

that  each  type-two  job  requires  exactly  one  tape,  and  that  a 

finite  number  L of  tape  mounts  are  available  to  the  system. 

Thus,  the  total  number  of  type-two  jobs  at  TM,  Q and  C 

2 

cannot  exceed  L,  though  more  type  two  jobs  might  be  at  Q . 


As 


is 


a consequence,  it  is  possible  to  have  TM  empty  even 
not . 


if  Q 


Before  considering  the  box  marked  D in  Figure  6.4, 
consider  the  central-server  model  from  which  (ala  section  2) 
C will  receive  its  properties.  This  model  is  depicted  in 
Figure  6.2.  Since  each  type-two  job  has  its  own  tape,  and 
since  all  tapes  must  be  mounted  before  a job  can  enter  C, 
there  is  no  queuing  for  tape  usage  and  no  degradation  cf 
service  tc  jobs  using  tapes  if  another  job  begins  to  use  a 
tape.  Thus,  all  tape  drives  together  may  be  considered  as  a 
single,  infinite  server  queue.  Letting  PP 1 be  this  queue. 


a^  =0  since  no  type-one  jobs  use  tapes.  (Note  that  the 

tapes  model  discussed  in  Chapter  IV  meets  the  description 
given  here.) 


Now  consider  the  box  marked  D in  Figure  6.4.  This  box 
will  be  modelled  in  different  ways  for  different  models. 

For  example,  if  it  is  assumed  that  there  are  exactly  n^ 

type-one  jobs  and  n type-two  jobs  in  the  model  of  interest 

2 

at  every  instant  of  time,  box  D need  not  exist.  If  the  n^ 

and  n vary  tut  n + n remains  constant,  box  D may 
2 1 2 

represent  a "place"  where  in  zero  time  a job  does  or  dees 


not  change  type  according  to  a probanility  distribution.  On 

the  other  band,  box  D could  represent  source  and  sink  with 

jobs  entering  D disappearing  (leaving  the  system)  and 

periodically  new  jobs  being  created  (read  in)  and  routing  to 

Q or  Q according  to  job  type.  If  the  latter  is  the  case, 

1 2 

a maximum  number  of  jobs  in  the  network  should  be  fixed  to 


keep  the  state  space  finite. 
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Ignoring  the  effect  of  D on  the  state  description  (if 

any),  and  assuming  exponential  service  at  TM,  a state  of  the 

system  may  be  represented  as  (t  ,t  ,t  ,x  ,x  ,...x  ) where 

12  3 12  )c 

t = the  number  of  type-one  jobs  at  C 

1 

t = the  number  of  type-two  jobs  at  C 
t^  = the  number  of  (tvpe-two)  jobs  at  and  TM 

combined 

x ,x_,...,x  = the  order  of  job  types  at  Q 

12k  2 

The  restrictions  to  be  used  in  determining  which  nonnecative 

integer  vectcrs  represent  valid  states  include: 


Rule  1 
Rule  2 
Rule  3 
Rule  4 
system 
Rule  5 
Rule  6 


t < N. 

1 

t + t < N. 

1 2 

t < L. 

2 

t + t + t < maximum  number  cf  jobs  in 
12  3 


k = 0 if  t + t <N. 

1 2 

t + t ♦ t ♦ k < maximum  number  of  jobs 
12  3 


in  system.  If  the  total  number  of  jobs  is  fixed, 

this  sum  must  equal  the  total  number. 

Rule  7:  The  number  of  twos  in  (x  , x ,...,x  ) < 

1 2 k 

L - t . 

2 

For  each  such  state,  the  number  cf  jobs  in  service  at  TM  is 
the  maximum  possible  given  that  it  must  be  no  larger  than 

t , no  larger  than  the  number  of  servers  at  TM,  and  no 

larger  than  the  number  of  available  tape  drives.  The  number 
r available  tape  drives  is  L minus  the  sum  cf  t and  the 
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number  of  twcs  in  (x  ,x  ,...,x  ). 

1 2 k 


Notice  that  the  effect  of  changing  the  number  of  tape 
drives  may  be  studied  by  varying  L.  The  effect  of  changing 
the  number  of  operators  might  be  studied  by  changing  the 
number  of  servers  at  TM.  The  effect  of  dedicating  operators 
to  the  tape  mounting  operation  might  be  studied  by 
increasing  the  service  rate  at  TM.  The  service  distribution 
at  TM  could  also  be  modified  to  a generalized  Erlangian 
distribution  by  adding  another  component  to  the  state  vector 
for  each  server  (see  subsection  2.5  of  Chapter  II) . The 
case  of  "bulk  mounting"  can  also  be  modelled  if  an 
additional  component  is  added  to  the  state  vector.  In  bulk 
mounting  the  operators  wait  until  Q contains  at  least  t 

tapes  for  which  tape  drives  have  been  allocated.  They  then 

mount  tapes  until  either  all  drives  are  busy  or  Q is  empty. 

The  component  added  to  the  state  vector  should  be  one  when 
the  mounting  operation  is  underway  and  zero  otherwise.  It 
changes  from  zero  to  one  when  the  number  of  jobs  at  Q and 

the  number  of  available  tape  drives  both  reach  t and  from 

one  to  zero  when  one  cf  these  two  numbers  drops  to  zero. 

The  number  of  tapes  reguired  by  each  type-two  jcb  could 
also  be  generalized.  This  could  be  accomplished  by  using 
type-two  jobs,  type-three  jobs,  ...,  where  type-k  jebs 
require  that  k- 1 tapes  be  mounted. 

Now  consider  another  model  xn  which  the  decomposition 
anc  aggregation  concepts  are  useful.  Once  again  the 
aggregate  queue  will  be  a computer  which  can  be  represented 
as  a central-server  system.  This  time  the  problem  is  cue  of 
core  allocation. 
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THE  CCRE-AILOCATION  PROBLEM 


4 . 


One  of  the  constraining  factors  in  the  level  of 
multiprogramming  of  a modern  computer  is  the  amount  of 
primary,  cr  core,  storage  available.  How  available  core  is 
allocated  tc  the  jobs  awaiting  service  is  an  important 
decision  for  the  managers  of  a computer  facility.  For 
example,  suppose  a job  requiring  1G0K  is  at  the  front  of  the 
queue  and  a large  number  of  25K  jobs  follow  it.  If  25K 
becomes  available,  should  that  25K  remain  idle  until  1C0K 
has  accumulated  and  the  first  job  in  the  queue  can  be 
served?  Or  should  the  smaller  jobs  be  allowed  to  bypass  the 
10CK  job  and  utilize  the  available  core?  From  the 
standpoint  of  efficient  utilization  of  the  available 
resources,  the  latter  is  tne  course  to  adopt.  However,  in 
an  extremely  busy  computer  center  such  a policy  could  lead 
to  serious  turnaround  problems  for  larger  jobs  (and 
potential  less  of  goodwill  with  customers  who  are  providing 
a large  portion  of  the  center's  income).  In  addition, 
searching  long  input  queue  lists  for  a job  small  enough  to 
fit  into  available  core  can  be  a costly  overhead  item. 

An  alternative  to  both  the  strict  FCFS  scheme  and  the 
bypass  scheme  is  ore  in  which  the  queue  is  divided  intc  two 
parts.  Ite  first  k jobs  (i.e.,  those  which  have  been 
waiting  the  longest)  form  what  will  be  called  the  anteroom 
queue.  All  ether  jobs  form  the  "hallway"  queue.  Althcugn 
bypassing  is  permitted,  only  the  jobs  in  the  anteroom  queue 
can  be  allocated  core.  Thus,  it  is  necessary  to  search  only 
the  antereem  queue  of  k jobs  each  time  core  is  made 
available.  A job  from  the  hallway  queue  is  allowed  to  enter 
the  antereem  queue  each  time  core  is  allocated  to  one  of  the 
x jobs  in  the  anteroom  queue.  So w the  question  of  interest 
is:  What  value  of  k.  (what  size  of  anteroom)  will  provide 
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reasonable  service  for  large  jobs  without  serious  less  of 
efficiency?  Models  similar  to  those  presented  in  this 
section  cculd  be  used  as  a tool  by  managers  in  determining 
an  answer  to  this  question. 

Consider  the  model  depicted  in  Figure  6.5.  As  in 
section  3,  C is  the  computer  and  the  model  depicted  in 
Figure  6.2  is  analyzed  (ala  section  2)  to  determine  its 
properties.  Q represents  the  anteroom  queue  and  will 
contain  ax  most  k jobs.  Conceptually  box  D contains  the 
hallway  queue  and,  perhaps,  a source  and  sink  for  jebs  or  a 
jot  type  changing  facility.  In  the  models  discussed  here, 
the  contents  cf  D will  be  represented  by  a single  number,  if 
at  all. 

Suppose  that  the  computer  has  a total  of  M units  of  core 
avaiiaole  fer  users'  jobs.  (The  unit  of  storage  could  be  a 
byte,  IK  bytes,  100K  bytes,  a page,  or  some  other 
appropriate  unit.  M is  considered  to  be  an  integer,  as  is 
the  number  of  units  required  by  a single  job.)  The  jots  may 
be  classified  according  to  the  number  of  units  of  core 
required.  For  example,  suppose  that  type-i  jobs  require  i 
units  of  core  for  i = 1,  2,  ...,  M.  In  practice  there  may 

be  many  values  of  i for  which  no  jobs  ever  exist,  and  seme 
other  numbering  scheme  may  be  more  practical.  The  type  of 

each  job  is  determined  from  a probability  distribution, 

M 


Note  that  it  is  possible  for  there  to  be  core  available 
even  though  the  anterocn  queue  is  full  (i.e.,  contains  k 
jots).  For  example,  the  anteroom  queue  could  be  filled  with 
large  jots  when  a small  job  leaves  C. 

Each  time  a job  leaves  C,  the  anteroom  queue  is  searched 
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for  the  first  job  which  will  fit  into  the  available  core. 

If  one  is  fcund,  it  enters  C and  a job  from  the  hallway 
queue  joins  the  anterocm  queue  at  the  back.  If  core  is 
still  available,  the  anteroom  queue  is  searched  aqain.  This 
procedure  continues  until  either  no  core  is  available  or  no 
jet  in  the  anteroom  queue  will  fit  into  available  core. 

Frca  this  description  it  is  important  to  notice  three 
things.  First,  the  number  of  jobs  at  C is  variable. 

Second,  two  cr  more  jobs  can  enter  C simultaneously,  but 
jets  enter  C cnly  when  a job  leaves  C.  And  third,  a joo  can 
simultaneously  enter  the  anteroom  queue  from  the  hallway 
queue  and  enter  C without  delay  in  the  anteroom  queue. 


One  way  cf  representing  the  states  of  this 

core-allccaticn  model  is  with  a vector  of  length  M ♦ k 1 : 

(n  ,n  ,...,n  ,t  ,t  ,...,t  ,h).  For  i = 1,  2,  M,  n is 

1 2 K 1 2 k i 

the  number  of  type-i  joos  at  C;  for  j = 1,  2,  ...,  k,  t^  is 

the  type  cf  job  in  the  j-th  position  in  the  anteroom  queue; 

h is  the  number  cf  jobs  in  the  hallway  queue.  Note  that  the 
type  of  a jot  in  the  hallway  queue  does  not  matter  until 
that  job  enters  the  anteroom  queue.  Thus,  as  jobs  enter  the 

M 

anteroom  gueue,  the  probability  distribution  {q  } is 

i i=  1 


applied. 


If  the  model  is  closed,  jobs  leaving  C immediately  join 

the  hallway  gueue.  In  this  case  h need  not  be  retained  as  a 

part  of  the  state  description  since  it  can  always  be 

computed  from  the  total  number  of  jobs  in  the  system  ( N)  , 

the  number  cf  jobs  in  the  anteroom  queue  (usually  k) , and 

the  number  cf  jobs  at  C (the  sum  of  the  n ' s) . If  N is  so 

i 

large  that  there  are  always  k jobs  in  the  anteroom  queue,  N 
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need  not  be  specified  since  its  importance  is  primarily  to 

indicate  whether  or  not  jobs  are  available  in  the  hallway 

queue  when  a vacancy  occurs  in  the  anteroom  queue.  If  N is 

relatively  small  and  there  are  m < k jobs  in  the  anteroom 

queue,  then  t = t = ...  = t = 0 by  convention. 
m+1  m+2  k 

If  the  model  is  open,  jobs  leaving  C disappear  from  the 
system  and  new  jobs  are  created  (probably  according  to  some 
interarrival  time  distribution)  at  D and  enter  the  hallway 
queue,  the  anteroom  queue  or  the  computer  depending  upon  the 
state  of  the  system.  In  this  case  it  is  important  to  retain 
h.  The  potential  exists  in  the  open  model  for  the  entire 
system  to  empty  of  jobs.  The  potential  also  exists  for  the 
number  of  jots  to  become  infinite.  Thus,  in  order  to  retain 
a finite  model,  it  is  necessary  to  restrict  the  size  of  tne 
hallway  gueue. 

The  chcice  of  core-allocation  scheme  becomes  most 
critical  when  the  system  is  very  busy.  When  there  are  few 
jets  in  the  system,  turnaround  time  for  user  jobs  is  usually 
not  a problem  and  core  utilization  does  not  approach  ICO*  no 
matter  what  scheme  is  used.  Hence,  even  though  it  may  be 
mere  realistic  to  consider  an  open  model  than  a closed  model 
(after  all,  real  systems  do  occasionally  go  idle) , a closed 
model  (with  !i  large  and  unspecified  and  h omitted  from  the 
state  vector)  is  probably  a good  choice  for  investigating 
the  guesticn  pcsed  above.  Hereafter,  assume  a closed  system 
with  N large  enough  (though  unspecified)  to  insure  that 
there  are  always  k jobs  in  the  anteroom  queue. 

Note  that  (n  ,n  ,...,n  ,t  ,t  ,...,t  ) must  satisfy  the 
12  M 1 2 k 

following  constraints  to  represent  a valid  state  of  the 
system  described  above: 
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Rule  1: 


n > 0 for  i 
i 


1 # 2 ( . « • i 


a 


I 

i 


M 

Rule  2:  m = a - 2 ia  SO. 

i 

i=1 

Rule  3:  in  < t < a for  j = 1,  2,  ...»  k. 

j 

The  number  m calculated  in  Rule  2 is  the  core  available  for 
other  user  jets.  The  sum  in  that  equation  is  the  total  core 
in  use. 

Let  I = <H  + s)/2  where  s = 1 if  M is  odd  and  s = 2 if  H 
is  even.  Then  since  the  total  number  of  units  of  core 
available  for  user  jobs  is  a, 

M 

2 n <1 
~ i 
i=L 

Hence  the  state  vector  can  oe  shortened  by  replacing  the 

components  n , n , ...,  n by  a single  component  t , where 
I L+1  a 0 

t = i for  i = L,  1+1,  . ..,  a if  there  is  a type-i  job  at  C 

and  t = 0 if  nc  jcb  requiring  1 or  more  units  of  core  is  at 
0 

C.  If  k > a,  the  state  vector  can  be  further  reduced  hy 

replacing  the  components  t , t , ...,  t by  s , s , ...»  s , 

12  k 1 2 a 

where,  for  each  i = 1,  2,  ...,  a,  s is  the  position  of  the 

i 

first  type-i  ;ob  in  the  anteroom  queue.  If  there  is  nc 

type-i  jcb  in  the  anteroom  queue,  s = k + 1.  With  such  a 

i 

description,  the  type  of  a particular  job  would  not  become 

known  until  it  became  the  first  job  of  its  type  in  the 
anteroom  queue.  To  determine  the  type  of  a particular  job, 
it  is  necessary  to  use  a conditional  distribution  derived 
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L 


K 

from  {g  } . For  example,  if  s = 1,  s = 2,  s = 4 and  s 

i i=1  n 1 3 i 

> 4 for  i # 1 , 3 , a , the  third  job  in  the  anteroom  queue  is  of 

type  one  with  probability  g / (g  +g  ) and  of  type  M with 

1 1 M 

probability  g / (q  + q ) . Note  that  it  cannot  be  of  type 
M 1 M 

three,  for  example,  since  the  first  type  three  job  is  in 


position  four. 


Example  6.2 


Suppose  that  only  two  types  of  jobs,  large  and  ssall, 

utilize  the  system,  and  that  the  large  jobs  require  twc 

units  of  core  and  the  small  jobs  only  one.  Assume  that  the 

system  is  busy  enough  that  there  are  always  k jobs  in  the 

anteroom  queue.  A state  of  the  system  can  be  specified  by  a 

vector  (n  ,n  ,s  ,s  ) where  n is  the  number  of  type-i  -obs 
12  12  i 

in  the  computer  and  s is  the  position  of  the  first  type-i 

i 

jcb  in  the  anteroom  queue.  Since  only  two  types  of  jots  are 


under  consideration,  further  simplification  is  possible. 

First,  if  n is  specified,  n is  the  largest  integer  less 
1 2 

than  or  equal  to  (M- n^)/2.  If  this  were  not  the  case,  there 

would  be  two  or  more  units  of  core  available  and  a job  would 
enter  the  computer  from  the  anteroom  queue.  Second,  s and 


s are  net  beth  required.  For  if  s = 3,  s =1  and  the  job 
2 1 2 

in  the  second  position  is  of  type  two.  On  the  other  hand, 

if  s =1,  the  first  type-two  job  is  in  position  two  with 


probability  c , position  3 with  probaDility  q q , ...» 

'2  1 2 

k-2 

position  k with  probability  q^  q^,  and  not  in  the  anteroom 


I 


1 
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k - 1 

queue  with  prctability  a 


Thus,  a state  is  completely 


specified  by  the  ordered  pair  (n^,s^) . Note  that  at  mcst 

one  unit  cf  cere  can  be  idle,  and  that  this  can  happen  only 

when  there  are  no  type-one  jobs  in  the  anteroom  queue. 

A program  which  generates  the  states  and  the  balance 
equations  for  this  model  has  been  written  in  FORTRAN.  The 

input  parameters  are  q M,  k,  and  for  j = 0,  1,  ...,  a the 


probability,  EETA(1,j),  that  a type  one  job  is  next  to  leave 

C given  that  n^  = j.  The  states  are  sequenced  according  to 

a lexicographic  ordering  of  the  state  vectors  when  arranged 

as  (s  ,n  ).  With  this  sequencing  procedure  the  coefficient 

matrix  is  nearly  triangular.  Thus,  a direct  elimination 

method  is  used  to  solve  the  balance  equations.  A weakness 
of  the  program  is  that  it  effectively  assumes  that  the  mean 
time  between  departures  from  C is  one  time  unit,  independent 
of  the  state  cf  the  system.  This  difficulty  could  be 
overcome  by  letting  3£TA(i,j)  be  the  rate  at  which  type  i 
jots  leave  C given  that  n^  = j,  and  making  EETA(2,j)  input 

parameters  toe.  The  following  table  lists  the  steady-state 


probability  of  having  an  idle  unit  of  core  as  a function  of 
the  size  k cf  the  anteroom.  The  values  of  the  other 
parameters  are  g = .25,  H = 6 and  BETA  ( 1 , j)  = n /(n  +n  ). 


1 


1 


(Note  that  a newly  arriving  job  is  three  times  as  likely  to 


be  a large 


job  as  a 


small 


one. ) 


k 12  3 

Prob.  .35  .29  .2a 


4 

.21 


5 

.19 


6 

. 17 


7 

. 15 


8 

. 14 


9 

.13 
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Note  that  since  no  more  than  one  of  the  six  core  units 
available  can  be  idle  at  one  time,  utilization  of  core  is 
better  than  what  appears  to  be  indicated  in  this  table.  For 
example,  with  k = 3 utilization  of  core  is  at  [1.0  - 
(.24/6)  ] = 0.S6.  Increasing  k to  7 increases  utilization 
only  to  C.975. 

In  the  first  section  of  this  chapter  the  concepts  cf 
decomposition  and  aggregation  were  introduced,  and 
conditions  under  which  these  concepts  might  be  used  to  aid 
in  analyzing  a model  which  has  a central- server  submodel 
were  discussed.  The  second  section  discussed  more 
specifically  how  to  determine  the  properties  of  a g^eue 
which  is  an  aggregation  of  the  central-server  submodel. 
Finally,  the  last  two  sections  were  devoted  to  examples  of 
situations  in  which  these  techniques  might  be  applied. 
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- >■ 


• SCMMAR Y AND  REQUIREMENTS  FOR  FURTHER  RESEARCH 


This  final  chapter  consists  of  a brief  review  of  the 
first  six  chapters  with  special  emphasis  upon  areas  in  which 
further  research  and  development  are  needed.  The 
organization  is  by  chapter. 


1.  CHAP  HR  I 


Chapter  I,  after  an  introduction  to  the  motivation 
behind  the  work  that  this  thesis  represents  and  a preview  of 
the  contents  of  the  thesis,  was  used  to  establish  the 
terminology  and  notation  used  throughout  and  to  present  a 
rather  extensive  review  of  queuing-network  literature, 
particularly  as  applied  to  computer  applications.  In  the 
literature  review  several  areas  were  pointed  out  where 
further  research  is  required. 

One  such  area  concerns  the  equilibrium  output  process  of 
a single  queue.  To  be  specific;  "What  is  the  output 
process  cf  a queue  having  given  characteristics  (number  of 
servers,  gueuing  discipline,  capacity  and  service 
distributions)  given  a particular  input  process?"  This 
question  is  probably  too  general  to  answer  except  on  a 
case-by-case  basis.  In  view  of  the  variety  cf  types  of 
queues  which  lead  to  satisfaction  of  the  local-balance 
conditions  when  incorporated  into  a network  of  queues  (see 
the  discussion  of  the  work  of  3askett,  Chandy,  Muntz  and 
Palacios  [6]  in  subsection  5.3  of  Chapter  I),  it  would  be 
natural  to  start  with  cases  in  which  the  interarrival  and 
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service  tines  are  generalized  Erlangian,  the  queuing 
discipline  is  ES,  IS  or  LCFSPR,  and  the  capacity  is 
infinite.  The  author  suspects  that  the  "interdepartur e" 
times  will  te  found  to  be  generalized  Erlangian  also, 
perhaps  differing  with  job  type,  and  that  independent 
departure  streams  will  result  from  independent  arrival 
streams.  However,  this  is  purely  conjecture  since  no  work 
has  yet  teen  attempted  in  this  area.  If  positive  results 
concerning  the  departure  process  can  be  attained  for  queues 
of  this  type  and  also  for  queues  which  lead  to  violation  of 
the  local-balance  conditions  when  incorporated  into  a 
network,  a comparison  may  shed  new  light  on  fundamental 
differences  between  queue  types  which  effect  local  balance; 
or  a simplified  solution  form,  such  as  a product  form,  may 
be  detected  for  networks  of  queues  which  do  not  satisfy 
local-balance  conditions. 

This  last  point  leads  to  another  area  where  more  v 
research  is  required.  To  date  (to  the  author's  knowledge) 
there  is  no  set  of  necessary  and  sufficient  conditions  for 
existence  of  a product-form  solution.  Reversibility  is 
sufficient  but  not  necessary.  Except  possibly  for  the 
quasi-revers itle  models  of  Kelly  [64],  a product-form 
solution  has  been  exhibited  only  for  networks  satisfying  the 
conditions  of  local  balance.  However,  local  balance  has  not 
been  shown  tc  te  either  sufficient  or  necessary,  thougn  it 
may  be  both.  On  the  other  hand,  it  is  quite  possible  that 
there  are  networks  which  do  not  satisfy  the  local-balance 
conditions  and,  yet,  which  have  a product-form  solution.  A 
characterization  is  needed  for  networks  which  admit  such  a 
solution . 

Investigation  into  the  relationship  between 
quasi-reversitility  and  the  local- balance  conditions  may 
shed  some  light  in  this  area.  This  relationship  is  not 
currently  known.  Since  the  definition  of 


286 


quasi-reversibility  given  in  [64]  is  in  terms  of 
independence  of  departure  processes,  it  is  not  clear  whether 
this  concept  can  be  extended  to  apply  to  closed  networks. 
This  is  also  an  area  which  bears  more  research. 

Although  product-form  solutions  of  the  type  discussed  in 
Chapter  I have  received  ouch  attention,  the  possible 
existence  of  ether  solution  forms  should  nor  be  ignored. 

This  possibility  has  yet  to  bear  fruit.  However,  the  reason 
may  be  that  it  has  not  been  explored. 

2.  CHAPTER  II 

In  Chapter  II  the  problems  associated  with  determining 
the  steady-state  properties  of  a variety  of  Markovian 
queuing  networks  were  attacked.  The  topics  covered  include 
representation,  generation  and  storage  of  the  states  of  the 
system  and  generation  and  storage  of  the  balance  equations. 
The  networks  considered  include  multiple  job  types  and 
queues  having  a variety  of  possible  queuing  disciplines  (as 
defined  in  subsection  4.2  of  Chapter  I),  multiple  servers, 
generalized  Erlangian  service  distributions  and  finite 
capacity . 

The  representation  of  states  of  such  systems  as  integer 
vectors  provides  enough  information  within  the  vector 
representation  to  differentiate  states  from  one  another.  It 
also  leads  to  a convenient  method  of  generating  the  balance 
equations.  The  concept  of  constrained  lexicographic 
sequencing  of  integer  vectors  then  provides  the  key  to 
generation  of  the  states  and  efficient  storage  of  the 
balance  equations. 


II  as  other  generalizations  arise.  For  example,  the  concept 
of  bulking  was  introduced  in  subsection  2.7  (of  Chapter  II) 
and  dealt  with  briefly  in  subsections  3.9  and  4.7.  More 
detailed  work  will  be  required  before  bulking  is  actually 
incorporated  into  a iiodel.  However,  there  is  no  need  to 
invest  this  effort  until  an  application  is  found. 

Another  example  is  job-type  switching.  This  could  be 

incorporated  into  the  branching  probabilities  if  switching 

is  allowed  while  a job  is  in  transit  between  queues.  For 

example,  p could  be  the  probability  that  a type-i  job 

i, j;k,m 

completing  service  at  queue  j enters  queue  m as  a type-k 
job.  This  kind  cf  job-type  switching  is  considered  by 
Baskett,  Chandy,  Muntz  and  Palacios  in  [6]. 

As  a final  example,  such  non-Marxovian  generalizations 
as  correlated  branching  could  be  handled  by  appropriate 
choice  cf  vector  representation.  For  example,  if  the  choice 
of  branching  distribution  from  the  CPU  to  the  PP's  in  the 
central-server  model  depends  upon  which  PP  the  last  jot  to 
leave  the  CPU  routed  to,  the  addition  cf  a component  tc 
carry  this  information  leads  to  the  possibility  of  applying 
the  techniques  discussed  in  Chapter  II. 

The  models  discussed  throughout  the  thesis  assume  zero 
transit  time  between  queues.  Poisner  and  Eernholtz  [87,88] 
have  examined  models  which  would  satisfy  the  local-balance 
conditions  except  that  transit  times  have  arbitrary 
distributions.  The  possibility  of  extending  their  results 
tc  more  general  models,  such  as  those  discussed  in  Chapter 
II,  remains  an  open  question  and,  possibly,  a fertile  area 
for  further  research. 
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3.  CHAPIER  III 


Chapter  III  discussed  a variety  of  numerical  methods 
which  could  he  used  to  solve  the  balance  equations  resulting 
frcm  application  of  the  methodology  presented  in  Chapter  II. 
The  Gauss-Seidel  method,  discussed  in  subsection  4.3  (of 
Chapter  III) , is  the  method  chosen  by  the  author.  Reasons 
for  this  choice  have  been  given  in  Chapter  III. 

Many  cf  the  models  encountered  when  the  network  has  a 
central-server  structure  are  cyclic  in  nature.  In  fact,  the 
three  models  which  the  author  has  programmed  have  period  two 
(i.  e.r  they  are  "2-cyciic"  in  the  terminology  of  Chapter 
III) . Chapter  III  contains  a proof  that  the  Gauss-Seidel 
method  converges  to  the  steady-state  probanility 
distribution  in  these  2-cyclic  cases  so  long  as  the  states 
are  arranged  in  a rather  natural  order  (the  third  canonical 
form) . It  is  conjectured  further  that  the  Gauss-Seidel 
method  will  converge  to  this  distribution  no  matter  what  the 
order  of  the  states  (see  the  conjecture  in  subsection  4.3). 

This  conjecture  introduces  an  area  waich  could  use 
further  research.  Also  included  in  this  area  is  the 
question  cf  when  convergence  of  the  Gauss-Seidel  method  can 
be  proved  for  k-cyclic  queuing  models.  It  was  shown  in 
Chapter  III  that  convergence  can  be  proved  if  the  rate 
matrix  has  first  canonical  form,  and  that  lack  of 
convergence  can  be  expected  if  the  rate  matrix  has  second 
canonical  form  (unless  k = 2) . However,  if  a canonical 
form,  similar  to  the  third  canonical  form  for  2-cyclic 
models,  is  found  to  arise  naturally  for  the  general  k-cyclic 
model,  convergence  of  the  Gauss-Seidel  method  for  this 
canonical  form  is  still  an  open  question. 

Another  area  which  is  open  for  further  research  is 
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acceleration  of  the  convergence  of  the  Gauss-Seidel  method. 
Two  possible  methods  for  doing  this  are  suggested  in 
subsection  4.4  (of  Chapter  III):  a relaxation  procedure 

and  an  "informed"  choice  of  starting  vector.  Neither  method 
has  been  adequately  explored. 

Other  possible  solution  methods  might  also  bear  further 
examination.  For  example,  specialized  codes  for  solution  of 
linear  programming  problems  have  been  considered.  If  one  of 
the  balance  equations  is  chosen  to  be  the  objective  function 
and  the  normality  condition  and  the  other  balance  equations 
make  up  the  constraints,  the  steady-state  probability 
distribution  will  be  the  only  solution  to  the  minimization 
problem.  Onf ortunately,  the  fact  that  this  is  a square 
problem  (the  number  of  constraints  equals  the  number  of 
variables)  makes  a linear  programming  approach  a poor  choice 
given  current  technology.  The  reason  is  that  the  simplex 
method  would  require  inversion  of  the  whole  matrix,  rather 
than  some  relatively  small  trices  as  is  usually  the 

case  with  linear  programs.  _ advantages  cf  the  iterative 
techniques  described  in  Chapter  III  over  the  direct 
technique  used  in  the  simplex  method  have  already  been 
mentioned.  Many  cf  the  problems  of  interest  are  not  known 
to  have  any  kind  of  special  structure. 


4.  CHAPTFB  IV 


Chapter  IV  reported  the  results  of  three  models  which 
have  been  programmed  using  the  methodology  discussed  in 
Chapters  II  and  III.  Two  job  types  are  assumed  by  each 
model,  the  types  being  differentiated  by  their  service  rates 
and  branching  probabilities.  Among  the  queues  represented 
in  the  three  models  are  found  an  IS  queue,  a PS  queue  and 
both  single-  and  multiple-server  FCFS  queues. 
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An  example  in  section  2 (of  chapter  IV)  showed  the  type 
of  errors  which  could  result  from  making  simplifying 
assumptions.  Unfortunately,  many  reasonable  models  could 
result  in  unmanageably  large  state  spaces  if  such 
assumptions  are  not  made.  In  subsection  2.2  ways  of 
approximating  a network  which  violates  the  local-balance 
conditions  with  one  which  satisfies  them  were  considered. 

The  results  for  the  approximations  considered  were 
discouraging.  Mere  research  is  required  in  this  area. 

Related  to  this  is  work  currently  underway  by  Lehoczky 
and  Gaver.  Ey  switching  to  a modified  PS  queuing  discipline 
and  adjusting  the  service  rates,  they  have  developed  a 
technique  for  reducing  the  size  of  the  state  space.  In  this 
way  problems  which  would  otherwise  be  too  big  can  be  reduced 
tc  a manageable  size.  Comparisons  between  runs  of  the  FCFS 
program  and  runs  using  their  approximation  method  reveal 
excellent  agreement  in  idleness  probabilities  and  average 
occupancies  at  the  various  queues.  Publication  of  the 
method  anc  the  results  is  forthcoming. 

Another  area  where  further  research  is  required  is  the 
inaccuracies  resulting  from  application  of  Norton's  theorem, 
as  discussed  by  Chandy,  Herzog  and  Woo  [21],  to  models  which 
do  not  satisfy  the  local-balance  conditions.  For  example,  a 
Norton's  theorem  analysis  could  be  applied  to  a FCFS  model 
and  the  results  compared  to  a run  of  the  same  case  using  the 
FCFS  program. 


5.  CHAPTER  V 

The  possibility  of  bias  in  data  gathered  by  software 
monitors  was  discussed  in  Chapter  V.  The  author  knows  of  no 
otner  work  in  which  this  problem  has  been  mentioned,  much 
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less  examined.  In  that  chapter  a procedure  was  discussed 
for  using  a queuing  model  to  estimate  the  results  which 
wculd  be  received  from  use  of  two  different  types  of 
software  monitors.  Auxiliary  results  from  application  of 
this  procedure  could  then  be  used  to  measure  the  extent  of 
the  bias.  This  could  be  used  to  help  explain  differences 
between  measures  of  performance  as  determined  using  a 
software  monitor  and  those  determined  using  an  analytic 
queuing  mcdel. 

This  procedure  has  not  yet  been  applied  to  any  numerical 
example.  This  is  an  area  open  for  further  work.  Also, 
ether  models  cf  software  monitors  have  yet  to  be  examined  in 
this  context. 

However,  a potentially  mere  important  area  of  research 
is  the  dual  cf  the  question  considered  in  Chapter  V:  "How 

are  true  system  parameters  and  measures  of  arformance  to  be 
determined  frem  software  monitor  data  which  is  known  tc  be 
biased?"  This  guestion  has  not  been  addressed.  On  the 
other  hand,  a related  question  can  be  attacked  using  the 
procedure  given  in  Chapter  V (assuming  the  queuing  model 
used  is  an  accurate  representation  of  the  system  modelled) . 
It  is:  "What  is  the  effect  of  using,  in  a queuing  model, 

system  parameters  estimated  from  data  gathered  by  a biased 
software  monitor?"  Much  research  remains  to  be  done. 


6.  CHAPTER  VI 


In  Chapter  VI  some  potential  uses  of  the  central-server 
model  as  a submodel  were  discussed.  In  general,  the  method 
discussed  involves  replacing  the  central-server  submodel 
with  a single  aggregate  queue  having  state-dependent 
exponential  servers.  Determination  of  the  rates  of  service 


at  this  aggregate  queue  are  based  upon  the  steady-state 
solution  of  the  ce ntral- server  submodel  for  each  of  the 
feasible  job  mixes. 

As  two  examples  of  cases  in  which  this  technique  might 
be  useful,  the  tape-mount,  problem  and  the  core-allocation 
problem  were  discussed.  The  former  problem  involves 
consideration  of  the  time  spent  by  operators  in  mounting  the 
tapes  required  by  user  jobs.  The  latter  problem  involves 
consideration,  and  possible  comparison,  of  different  methods 
for  deciding  which  of  the  various  jobs  waiting  in  the  input 
queue  of  a computer  will  oe  allowed  entry  when  core  becomes 
available.  The  two  job  types  considered  require  different 
amounts  of  cere.  Thus,  the  problem  becomes:  "When  a small 

amount  of  core  becomes  available,  should  a job  requiring 
that  amount  of  core  be  allowed  to  bypass  earlier-arriving 
jobs  which  require  more  core  than  is  currently  available?" 

The  application  of  the  concepts  of  decomposition  and 
aggregation  to  models  in  which  a central-server  model, 
representing  a computer,  is  a submode'l  has  only  been 
outlined  in  Chapter  VI.  The  author  knews  of  no  earnest  work 
in  this  area.  The  core-allocation  problem  discussed  here  is 
particularly  ripe  for  development  and  extension. 
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APPENDIX  A 


THEOBETICAL  DEVELOPMENT  OF  THE  BALANCE  EQUATIONS 


In  this  appendix  theoretical  considerations  are  outlined 
which  lead  tc  development  of  the  systems  of  linear  equations 
whose  solution  yields  the  steady-stare  probabilities  for  rhe 
queuing  models  of  interest. 

Assume  that  the  system  of  interest  can  be  described  in 
terms  of  a finite  number,  say  N,  of  states,  and  number  the 
states  from  one  to  N.  Assume  further  that  time  is  measured 
from  a point,  t = 0,  at  which  a change  in  the  state  of  the 
system  occurs. 

Define  a random  variable  X (t)  to  be  the  state  of  the 
system  at  time  t.  By  convention  if  a transition  occurs  at 
time  t,  X (t)  is  the  state  resulting  from  the  transition,  not 
the  state  prior  tc  the  transition.  Also,  define  P (t)  to 

i j 

be  the  probability  that  tne  system  is  found  in  state  j at 
time  t given  that  it  starts  in  state  i.  That  is, 

(A . 1 ) P (t)  = Prob  {X  ( t)  = j J X (0)  = i} 

ij 

Define  epochs,  t = 0 < t <t  < ...,  to  be  the  times 
0 1 2 

at  which  transitions  occur.  Note  that  X(t)  = X(t  ) if  t < 

i i 

t < t . Then  the  random  variable  T = t - t is  the 
i+1  i i i-1 
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time  between  epochs  i - 1 and  i.  It  is  also  the  length  of 

tine  that  the  system  stays  in  state  X (t  ) after  the 

i-  1 

(i-  1)  -th  epoch . 

If  X (t  ) = k,  let  F (x)  be  the  cumulative  distribution 
i- 1 k 

function  for  T . Assume  that  (for  k = 1,  2,  ...,  N)  F (0+) 
i k 

= 0 and  that  I depends  only  on  the  state  of  the  system 
i 

between  the  epochs  i - 1 and  i.  That  is,  T is 

i 

stochastically  independent,  of  i,  each  t , T for  j * i and 

j j 

X (t  ) for  j 4 i - 1. 

j 

Consider  a network  of  queues  in  which  at  least  two  jobs 
can  receive  service  simultaneously.  Then,  completion  of 
service  of  a job  will  very  likely  result  in  a change  in  the 
state  of  the  system.  (Naturally,  hypothetical  examples  can 
be  devised  in  which  this  is  not  the  case.  However,  in  the 
more  general  cases  of  interest  here,  this  statement  holds.) 
But,  if  a jot  completes  service  while  another  job  is 
receiving  service,  future  time  between  epochs  will  be 
affected,  net  by  the  distribution  of  service  time  of  this 
latter  jot,  tut  by  a conditional  distribution  of  remaining 
service  time.  That  is,  future  epochs  may  net  be  independent 
of  history.  However,  an  elegant  theory  resulting  from 
renewal  arguments  cannon  be  applied  unless  some  guarantee 
can  te  offered  that  the  independence  assumptions  are 
satisfied.  If  all  service  times  (or  at  least  the  times 
between  epochs)  are  exponentially  distributed,  these 
guarantees  begin  to  appear  since  the  residual  lifetime 
distributions  are  identical  to  the  service  distributions. 
This  is  the  so-caileu  raemoryless  property  of  the  exponential 
distribution.  So  the  aim  in  modelling  is  the  determination 
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of  states  such  that  the  time  between  epochs  is  distributed 
exponentially. 

So,  assume  that  a system  has  been  modelled  such  that, 
for  each  i = 1,  2,  ...,  N, 

(A. 2)  F (x)  = 1 - exp[-c  (t)x] 

i i 


where  c ( t)  >0  depends  upon  the  age  t of  the  process  <i. 
i 

e.,  the  time  since  t = 0)  but  not  the  time  x since  the 
system  last  entered  state  i.  Note  that  this  choice  for 

F (x)  satisfies  the  assumption  that  F (0+)  = 0. 

i i 

Furthermore,  the  probability,  S (t,t+h),  that  the  system  is 

ij 

found  in  state  j at  time  t + h given  that  it  is  in  state  i 
at  time  t approaches  zero  if  i * j,  and  one  if  i = j,  as  h 
approaches  zero.  Since  the  probability  that  the  system 
transitions  from  state  i to  other  states  and  back  to  state  i 
again  in  time  h goes  to  zero  as  h approaches  zero, 

S (t , t + h)  is  approximately  egual  to  exp[-c  (t)h]  for  small 

ii  i 

h and 


(A. 3)  lim  [1  - S (t , t + h)  ] / h = c (t) 

ii  i 

h-->0 


This  is  assumption  1 of  Chapter  XVII,  section  9 of  Feller 
[16]. 

Now,  define  g (t)  to  oe  the  probability  that,  if  the 

ij 

system  changes  state  from  state  i at  time  t,  it  will 
transition  into  state  j;  or,  succinctly. 
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(A. 4)  g (t)  = Prob  {X  (t  ) = j | X (t  ) = i and  t = t} 

ij  k k-1  k 


Note  that  g (t)  depends  upon  the  age  of  the  process  but  not 

ij 

the  time  the  system  is  in  state  i.  Assuming  that  g (t)  is 

ij 

continuous. 


(A. 5) 


lim  [S  (t,t+h)  / h] 

i j 

h— >0 


= lim  [q  <t)F  (h)  / h] 
ID  i 

h— >0 


= c (t:  (t) 

l Ij 


so  long  as  i * j.  This  is  Feller's  assumption  2 (Chapter 
XVII,  section  9 of  [18]). 


Based  upon  these  tuo  assumptions  (and  a third  assumption 
which  is  trivially  satisfied  here  since  the  state  space  is 
finite)  Feller  derived  the  system  of  forward  differential 
eg  uations : 

(A. 6)  as  (s,t)/a>t  = -c  (t)S  (s , t) 

ik  k ik 

* 1 S.  , (s,t)  c . (t)  g (t) 

...  d-D  D D* 

D** 

This  system  of  equations  leads  to  the  system  of  linear 
equations  whose  solution  yields  the  steady-state 
prc  tabilities . 

Note  that  if  s is  fixed  at  zero. 
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(A.  7) 


S.  <0,t) 
13 


Prob  {X  (t)  = 3 | X(0)  = i} 


P.  . (t) 
13 


Hence,  the  system  (A. 6)  becomes: 

(A. 8)  P'  (t)  = -c  (t)P  (t)  ♦ 2 P.  . (t)c  . (t)  g (t) 

lk  k lk  lj  3 3k 


Suppose  that  there  is  some  probability  distribution 


N 

{v  } for  the  state  cf  the  system  at  time  zero.  That  is, 
i i=1 


for  each  i,  let  v = Prob[X(0)  = i}  . Then,  multiplying 


(A. 8)  by  v and  summing  over  i: 
i 


(A. 9)  P'  (t)  = -c  ft)  P.  (t)  ♦ 2 P . (t)  c (t)  g (t) 

k k * 3 3 3* 

3^k 


where  ? (t)  is  the  sum  over  i of  the  product  P (t)  v . This 
k ik  i 

is  not  tc  say  that  the  probability  that  X (t)  = k is 

independent  cf  the  state  X(0),  but  rather  that  the 

unconditional  distribution  P (t)  = Prob{X(t)  = k}  satisfies 


the  same  differential  equation  that  the  conditional 


distribution  satisfies. 


Now,  assume  that  a steady-state  distribution  [P  } 

k k = 1 


exists.  Then,  as  t approaches  infinity,  P (t)  approaches  P 

k k 

and  ?'  (t)  approaches  zero.  E is  the  long  run  averaae 
k k 
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percentage  of  time  that  the  system  is  found  in  state  k.  If 

it  is  further  found  that  c (t)  has  a limit  c and  q (t)  has 

k k jk 

a limit  q , then  (A. 9)  becomes  the  system  cf  linear 

jk 

equations,  called  the  balance  equations: 


(A. 10)  c F = 5 c q P 

k k - j9jk  j 
g#k 


From  the  interpretation  given  aoove  £or  the  distrituti 

{P  } it  is  seen  that 
k 


on 


(A. 11) 


N 

5 P 

) 

k=  1 


This  is  called  the  normality  condition. 
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APPENDIX  B 


ALGORITHMS  OF  CHAPTER  II 


This  appendix  contains  the  algorithms  referred  to  in 
Chapter  II  and  is  not  intended  to  be  read  separately  from 
Chapter  II.  Most  of  the  algorithms  are  written  with  FORTRAN 
programming  in  mind.  Many  of  them  are  accompanied  by 
examples  which  demonstrate  their  use  step  by  step.  In  the 
examples  Reman  numerals  in  parentheses  refer  to  step  numbers 
of  the  corresponding  algorithm.  Since  many  of  the 
algorithms  involve  vectors,  it  is  appropriate  to  remark  that 
the  components  of  a vector  are  numbered  from  left  to  rignt 
by  conventicr.  Thus,  the  first  component  is  the  leftmost 
component  and  the  last  component  is  the  rightmost. 

B . 1 . ALGORITHM  1:  LEXICOGRAPHIC  SEQUENCING  OF  INTEGER 

VECTORS 


Algorithm  1 is  for  the  lexicographic  sequencing  of  all 
nennegative  integer  vectors  satisfying  a collection  of 
constraints . 

A nornegative  integer  vector  is  simply  a vector  all  of 
whose  components  are  nonnegative  integers.  The  algorithm 
will  work  equally  well  on  other  types  of  vectors  so  long  as 
there  is  a cne-to-one  mapping  from  the  set  of  feasible 
values  for  the  components  into  the  set  of  nonnegative 
integers . 
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The  constraints  are  simply  a set  of  rules  which  provide 
seme  restriction  on  the  values  the  components  may  take  on. 

It  is  assumed  that  the  components  have  been  numbered  sc  that 
the  first  application  of  any  given  component  may  be  made  at 
such  a time  that  reference  need  be  made  only  to  the  values 
of  components  to  the  left  of  the  component  affected.  For 
example,  a constraint  that  the  value  of  the  first  component 
must  be  equal  to  the  sum  of  the  values  of  the  second  and 
third  components  will  not  explicitly  affect  the  value  cf  the 
first  component.  Rather,  the  second  component  will  be 
restricted  to  be  less  than  or  equal  to  the  first,  and  the 
third  component  will  be  restricted  to  be  equal  to  the 
difference  between  the  first  two.  (For  simplicity,  "the 
i-th  component"  will  often  be  used  to  mean  "the  value  cf  the 
i-th  component"  when  the  context  permits.) 

Throughout  this  algorithm,  k and  m refer  to  component 
numbers;  n is  a counter  which,  at  any  point  in  application 
of  the  algorithm,  indicates  the  number  of  vectors  which  have 
been  enumerated  to  that  point.  All  vectors  are  assumed  to 
have  fixed  length  K. 

Algorithm  1 

(i)  Let  k = 1,  n = 0 and  m = K. 

(ii)  For  each  value  of  k from  its  current  value  through 

[ 

k = K,  let  the  k-th  component  equal  its  smallest  possible 
value  subject  to  the  constraints.  If  this  cannot  be  dene, 
go  to  (v)  . 

(iii)  Increase  n by  1.  The  current  vector  is  the  n-th 
vector . 

(iv)  If  component  m is  at  the  largest  value  it  can  have 
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and  still  satisfy  the  constraints,  go  to  (v) . Otherwise, 
increase  component  m to  its  next  larger  feasible  value.  If 
m = K,  go  to  (iii) . Otherwise,  let  k = m + 1,  let  m = K, 
and  go  to  (ii) . 

(v)  Decrease  i by  1.  If  i > 0,  go  to  (iv)  . Otherwise, 
all  vectors  satisfying  the  constraints  have  been  enumerated 
There  are  n such  vectors.  STOP. 

Example  E-1 

Problem:  Enumerate  all  nonnegative  integer  vectors  of 

length  K = 3,  whose  first  component  is  larger  than  the  sum 
of  the  other  two  components,  and  the  sum  of  whose  component 
is  no  larger  than  5. 

Solution : 

(i)  k = 1 ; n = C ; m = K = 3. 

(ii)  k=  1 : Since  each  of  the  second  and  third 
components  can  be  no  smaller  than  zero,  and  since 
the  first  component  must  be  larger  than  the  sum  of 
the  ether  two,  the  first  component  must  be  set 
equal  tc  one. 

k=2,3:  The  other  two  are  set  equal  to  zero. 

(iii)  n = 1;  the  first  vector  is  {1,0,0}. 

(iv)  The  third  component  is  at  the  only  value  it 
can  have  and  still  satisfy  the  constraint  that  the 
sum  cf  the  second  and  third  components  be  less 
than  the  first. 

(v)  m = 2. 

(iv)  The  second  component  also  cannot  be  changed 
without  violating  the  constraints. 

(v)  m = 1. 

(iv)  Component  1 is  increased  to  2;  k = m+1  = 2;  m 
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i 


= K = 3. 


(ii)  k=2,3:  Eoth  the  second  and  third  components 
are  set  equal  to  zero. 

(iii)  n = 2;  the  second  vector  is  (2,0,0). 

(iv)  The  third  component  is  set  equal  to  1. 

(iii)  n = 3;  the  third  vector  is  {2,0,1}. 

(iv)  No  change, 
iv)  o = 2. 

(iv)  Component  2=1;  k = 3;  m = 3. 

(ii)  Component  3=0. 

(iii)  n = 4;  (2,  1 ,0}  . 

(v)  No  change. 

(v)  tt  = 2. 

(iv)  No  change. 


(v)  m = 1. 

(iv)  Component  1 = 3;  k = 2;  m = 3. 

(ii)  k-2,3:  components  2 and  3=0. 

(iii)  n = 5;  (3,0 ,0}  . 

(iv)  Component  3=1. 

(iii)  n = 6 ; {3,0,1}. 

(iv)  Component  3=2. 

(iii)  n = 7;  (3, 0,2}  . 

(iv)  No  change. 

(v)  m = 2. 

(iv)  Component  2 = 1;  k = 3;  m = 3. 

(ii)  k=3:  component  3=0. 

(iii)  n = 8 ; (3,1,0). 

Repeated  application  yields: 
n=  9 (3,1,1}  n = 10  {3,2,0}  n=11  {4,0,0} 

n=  1 2 {4,0,1}  n = 13  {4,1,0}  n = l4  {5,0,0} 

Note,  for  example,  that  {4,0,2}  is  not  a valid  vector 
since  the  sun  of  the  components  exceeds  5.  Also,  note  that 
if  the  braces  and  commas  are  dropped,  the  vectors, 
considered  as  three-digit  numbers,  are  in  numerical  order. 
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This  is  characteristic  of  lexicographic 
nonnegative  integer  vectors.  Algorithm 
of  creating  a three-digit  number  from  a 
vector  of  length  three. 


ordering  of 
2 provides  a method 
nonnegative  integer 


a. 2.  ALGORITHM  2:  TRANSLATION  OF  A VECTOR  OF  LENGTH  K 

INTO  A K-EIGIT  NUMBER 

Algorithm  2 is  a computationally  efficient  method  cf 
translating  a vector  of  length  X into  a K-digit  number.  It 
is  assumed  that  each  component  of  the  vector  is  a 
nonnegative  integer  less  than  ten.  Throughout  the  algorithm 
k refers  to  a component  number  and  m is  used  to  accumulate 
the  K-digit  cumber. 


Algorithm  2 

(i)  Let  m = 0. 

(ii)  For  each  value  of  ic  from  one  through  K,  multiply  m 
by  10  and  add  the  value  of  component  k to  get  a new  value 
for  m . 

Example  E-2 

Problem:  Translate  {1,0, 5,5, 9}  into  a five-digit  number. 


Solution : 

(i)  m = 0. 

(ii)  k=1:  m 

k = 2 : m 
k = 3:  m 


0x10  +1=1 
1x10  ♦ 0 = 10 
10x10  ♦ 5 = 105 
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k = 4:  m 
k=5:  m 


105x10  ♦ 5 
1055x10  + 9 


1055 

10559 


Using  different  base  number  systems,  the  restriction 
that  the  digits  be  smaller  than  ten  can  be  relaxed.  Fcr 
example,  using  100  in  the  place  of  10,  the  vector  {10,9,88} 
would  be  translated  into:  100988. 

Using  a mcd  function,  this  procedure  can  be  reversed  to 

I translate  a given  number  intc  the  corresponding  vector  if 

the  number  base  is  given. 

B.3.  ALGORITHM  3:  STORAGE  OF  RIGHT  SUBVECTORS 

Algorithm  3 efficiently  stores  the  right  subvectors  in 
an  array  KSTG  without  generating  and  translating  them.  Each 
subvector  is  stored  as  a number  (as  though  Algorithm  2 had 
been  applied  to  the  vector  representations) . Recall  that 
each  right  subvector  is  a nonnegative  integer  vector  of 
length  M,  the  number  of  PP's,  and  that  the  sum  of  the 
components  of  each  right  subvector  cannot  exceed  N,  the 
total  number  of  jobs  circulating  in  the  system.  The 
algorithm  reguires  the  use  of  two  auxiliary  vectors,  NSTG1 
and  NSTG2,  each  of  length  N.  The  numbers  stored  in  KSTG  may 
be  separated  into  groups  according  to  the  sum  of  the  digits. 
Since  the  zero  group  contains  only  tne  number  zero,  it  is 
not  stored.  NSTG1  contains  pointers  to  the  beginning  of 
each  group;  and  NSIG2  contains  pointers  to  the  end  of  each 
grcup.  Thus,  NSTG2(i)  = NSTGI(i-M)  - 1. 
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Algorithm  3 


(i)  Let  NSTG1(1)  = 1,  and  for  k = 2,3,..., N,  let 

NSTG1  (k)  = NSTG  1 (k-1)  + C 

d-2+k, k- 1 

(ii)  For  k = 1,2,.  ..,N,  let  KSTG  (NSTG  1 (k) ) = k and 
NSTG2  (k)  = NSTG 1 (k) . Let  m = 10  and  k = 2. 

(iii)  Increase  NSIG2(1)  by  1,  and  let  KSTG  (NSTG2  (1) ) = 
m . 

(iv)  Let  i = N STG2  (k)  + 1 and  j = NSTG  1 (k-1). 

(v)  Let  KSTG  (i)  = KSTG ( j ) + a. 

(vi)  If  j > NS TG2  ( k— 1 ) , go  to  (vii) . Otherwise, 
increase  i and  j each  by  1 and  go  to  ( v)  . 

(vii)  Let  NSTG 2 (k)  = i.  If  k > N,  go  to  (viii)  . 
Otherwise,  increase  k by  1 and  go  to  (iv)  . 

(viii)  If  NSTG 2(1)  ♦ 1 < NSTG 1(2),  multiply  m by  10,  let 
k = 2,  and  co  to  (iii)  . Otherwise,  all  right  subvectors 
have  been  stored  in  KSTG.  STOP. 


Example  E-3 

Problem:  Stcre  the  right  subvectors  in  a case  with  N = 3 

jobs  and  a = 3 PP's. 

Solution : 

(i)  NSTG 1 ( 1 ) = 1,  NSTG1  (2)  = 1 + 3=4,  NSIG1  (3)  = 

4 ♦ 6 = 10. 

(ii)  KSTG  ( 1 ) = 1,  NSTG2  (1)  = 1 
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KSTG  (4)  = 2,  NSTG2  (2)  = 4 

KSTG  (10)  = 3,  N5TG  2 (3)  = 10,  m = 10,  k = 2 

(iii)  NSTG2  (1 ) = 2,  KSTG  (2)  = 10 

(iv)  i = 5,  j = 1 

(v)  KSTG  (5)  = 1 + 10=11 

(vi)  i = 6,  j = 2 

(V)  KST G (6)  = 10  + 10  = 20 

(vi)  no  changes 

(vii)  NSTG2(2)  = 6,  k = 3 

(iv)  i = 11,  j = 4 

(v)  KSTG  (11)  = 2 + 10  = 12 

(vi)  i = 12,  j = 5 

(v)  KSTG  (12)  = 21 

(vi)  i = 13,  j = 6 

(v)  KSTG  ( 13)  = 30 

(vi)  no  changes 

(vii)  N STG2  (3 ) = 13 
(viii)  ni  = ICO,  k = 2 

(iii)  NSTG2  (1 ) = 3,  KSTG(3 ) = 100 

(iv)  i = 7,  j = 1 

(v)  KSTG  (7)  = 101 

(vi)  i = 8,  j = 2 

(v)  KSTG  (8)  = 110 

(vi)  i = 9,  j = 3 

(v)  KSTG  (9)  = 200 

(vi)  no  changes 

(vii)  NSTG2  (2)  = 9,  k = 3 

(iv)  i = 14,  j = 4 

(v)  KSTG  (14)  = 102 

(vi)  i = 15,  j = 5 

(v)  KSTG  (15)  = 111 

(vi)  i = 16,  j = 6 

(v)  KSTG  (16)  = 120 

(vi)  i = 17,  j = 7 

(v)  KSTG  (17)  = 201 

(vi)  i = 19,  j = 6 
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(V)  KSTG  ( 18)  = 210 
(vi)  i = 19,  j = 9 

(v)  KSTG  (19)  = 300 

(vi)  no  changes 

(vii)  NSTG2  (3 ) = 19 
(viii)  STOP 

The  resulting  KSTG  vector  is  {1,  1Gf  100,  2,  11,  20,  101, 
11C,  200,  3,  12,  21,  30,  102,  111,  120,  201,  210,  300}. 

NS1G1  = (1,  4,  10}  points  to  the  beginning  ci  each  group  and 
NSTG2  = {3,  S,  19}  points  to  the  end  of  each  group. 

B.4.  ALGORITHM  4:  DETERMINATION  OF  STORAGE  LOCATION  IN 

LSI  G 


Algorithm  4 allows  determination  of  the  storage  loaction 
of  a given  left  subvector  from  the  vector  representation 
itself.  This  precludes  the  necessity  cf  translating  the 
left  subvectcr  into  a number  (say,  using  Algorithm  2)  and 
doing  a search  through  LSTG.  Recall  that  N is  the  number 

of  ones  and  N the  number  of  twos  in  the  left  subvector. 

2 

Throughout  the  algorithm  j refers  to  the  component  numbers 

of  the  left  subvector,  m refers  to  locations  in  LSTG,  and  i 
is  the  value  cf  the  j-th  component  of  the  left  subvector. 

Algorithm  4 

(i)  let  L = N -1,  L = N , m = 1 and  1=1. 

112  2 

(ii)  Let  i be  the  value  of  the  j-th  component  of  the 
left  subvectcr. 


(iii)  If  i = 2,  go  to  (iv) . Otherwise,  decrease  L 
1.  If  L is  negative,  go  to  (vi)  . Otherwise,  go  to  (v) 


(iv)  Increase  m by  C . Decrease  I by  1 . 

L +L  , L 2 

1 2 1 

If  L is  positive,  go  to  (v)  . Otherwise,  go  to  (vi) . 
2 


(v)  Increase  j by  1.  Go  to  (ii)  . 

(vi)  The  current  value  of  a is  the  desired  location 
number.  STOE. 


Example  E-4 

Problem:  With  N =2  and  N =2  find  the  location  of 

1 2 

{1,2, 2,1}  in  LSTG . (See  Example  2.9  in  Chapter  II.) 


Solution : 


(i)  I = 1;  L = 2;  m = 1;  j = 1. 

1 2 

(ii)  i = 1. 

(iii)  L =0. 

1 

(v)  j = 2. 

(ii)  i = 2. 

(iv)  m = 1+1  = 2;L  =0. 

2 

(v)  j = 3. 

(ii)  i = 2. 

(iv)  m = 2 ♦ 1 = 3;  L =0. 

2 

(vi)  the  location  is  m = 3.  STOP. 


by 


3.5.  ALGORITHM  5:  STORAGE  OF  VARIABLE-LENGTH  LEFT 

SUBVECTORS  IN  1ST ATEm  1 ORDER 

Algorithm  5 is  for  storage  of  the  variable-length  left 
subvectors  when  the  states  are  ordered  according  to  a 
lexicographic  ordering  of  the  ISTATEml  vector 
representation.  Throughout  the  algorithm  k is  the  length  of 
the  subvectors  being  stored,  m is  the  location  in  LSTG  of 
the  last  subvector  stored,  i is  used  as  an  index,  j points 
to  the  end  cf  a block  of  stored  subvectors  having  common 
length,  and  NO  is  a scratch  array  used  to  store  the  number 
of  ones  in  the  vector  stored  in  the  corresponding  position 
of  LSTG.  While  storing  tne  left  subvectors  in  LSTG,  the 
algorithm  stores  pointers  in  NSTG2.  At  completion  of  the 
algorithm  component  NSTG2  (k)  ♦ 1 of  LSTG  Mill  contain  tne 
first  vector  and  component  NSIG2(k+1)  the  last  vector  of 
length  k.  L is  the  number  or  servers  at  the  CPU. 

Algorithm  5 

(i)  Let  k = max  ( 1 , N-L)  . This  is  the  smallest  number  of 

digits  in  any  number  to  be  stored  in  LSTG.  For  i = 1,  2, 

...,  k,  let  NSTG2  ( i)  = 0.  Also,  let  m = 0.  Use  Algorithm  1 

to  sequentially  generate  all  vectors  of  length  k consisting 

sclely  of  ones  and  twos  with  no  more  than  N ones  and  N 

1 2 

twos.  Each  time  a new  vector  is  generated,  increase  m by 

one,  translate  the  vector  into  a k-digit  number,  and  store 
the  number  in  LSTG  (m)  . Also,  store  in  NO(m)  the  number  of 
ones  in  LSTG  (m) . Let  i = 0. 

{ ii ) Increase  k by  one.  Store  the  value  cf  m in 
NSIG2(k) . If  k = N,  noth  LSTG  and  NSIG2  are  complete. 

STOP.  Otherwise,  let  j = m and  proceed. 
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(iii)  Increase  i by  one.  Let  a = LSTG  (i)  and  b = NO  (i)  . 
If  b = N , go  to  (iv) . Otherwise,  increase  m by  one  and  let 

LSTG(m)  = a x 10  ♦ 1.  If  k is  less  than  N,  let  NO  (a)  = b + 

1.  Otherwise,  let  NO(a)  = b.  If  It  - b = N , go  to  (v)  . 

2 

Otherwise,  proceed. 

(iv)  Increase  a by  one  and  let  LSTG  ( a)  = a x 10  + 2. 

Let  NO  (m)  = t. 

(v)  If  i is  less  than  j,  go  to  (iii)  . Otherwise,  go  to 
(ii)  . 

For  an  example  see  Example  2.11(a)  in  Chapter  II. 


B.6.  ALGORITHM  6:  DETERMINATION  OF  NSTG4  FROM  NSTG1  AND 

NS1G2 

Algorithm  6 is  for  determination  of  the  values  required 
in  the  vector  NSTG4  from  the  values  already  stored  in  NSTG1 
and  NSTG2. 

Algorithm  6 

(i)  Let  i = 1 and  k = max(0,N-L)  . If  k = 0,  let 
NS1G4  ( 1 ) = 1.  Otherwise,  let  NSTG4(1)  = NSTG2(k+1)  - 
NS1G2  (k)  . 

(ii)  Let  a = NSIGl(i*1)  - NSTGI(i).  Let  k = max(i,N-L) 
and  increase  i by  one.  Let  NSTG4 (i)  = a x [NSTG2(k+1)  - 
NSTG2  (k)  j. 
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(iii)  If  i < N,  go  to  (ii) . Otherwise,  NSTG4  is 
complete.  SIOP. 

Example  E-5 

Problem:  A case  with  L = N = H = 2 and  N = 3 is 

1 2 

considered  ir  Example  2.11  of  Chapter  II.  From  part  (a)  it 

is  seen  that  NSTG1  = {1,  3,  6,  10,  15,  21}  and  NSTG2  = {0, 
C,  0,  7,  17,  27}.  Determine  NSTG4. 

Solution : 


(i)  i = 1 sk 

= 3;  NSIG4 ( 1 ) 

= 7-0 

= 7. 

(ii)  a = 3 - 

• 1 = 2;  k = 3 

i = 2* 

NSTG4  (2) 

= 21. 

(ii)  a = 3; 

k=3;i=  3; 

'ISTG4  (3) 

= 42. 

(ii)  a = 4; 

k = 3;  i = 4; 

NSTG4  (4) 

= 70. 

(ii)  a = 5; 

k = 4;  i = 5; 

NSTG4  (5) 

= 120. 

(iii)  NSTG4 

is  complete. 

STOP. 

B.7.  ALGORITHM  7:  STORAGE  OF  VARIABLE-LENGTH  LEFT 

SUE VECTORS  IN  ISTATEm2  ORDER 


Algorithm  7 is  for  storage  of  the  variable-length  left 
subvectors  when  the  spates  are  ordered  according  to  a 
lexicographic  ordering  of  the  ISTATEm2  vector 
representation.  Throughout  the  algorithm  r is  the  location 
in  LSTG  where  the  next  subvector  is  to  be  stored,  s is  the 
location  in  NSTG3  where  the  last  number  was  stored,  and  t is 
the  length  of  the  vectors  being  stored  (also,  the  location 
in  NSTG2  where  the  last  number  was  stored) . For  each  s 
NSTG3 (s)  is  a location  in  LSTG  where  either  the  number  of 
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digits,  the  number  of  ones,  cr  both  change.  For  each  t 
NS1G3  (NS1G2  (t) ) is  the  location  in  LSTG  of  the  first 
sutvector  of  length  t.  Past  (ii)  i is  the  location  in  LSTG 
of  the  subvector  to  be  considered  next  for  generating 
another  subvector.  Control  is  maintained  in  the  algorithm 
with  the  aid  of  j and  m. 


Algorithm  7 

(i)  Set  NSTG2  ( H)  = 1,  NSTG3(1)  = 1,  r = 1,  s = 2 and  t = 
N - 1 . 

(ii)  In  lexicographic  order  generate  all  vectors  of 

length  N consisting  of  N ones  and  N twos.  Each  time  a new 

1 2 

vector  is  generated,  translate  it  to  a number,  store  the 
number  in  LSTG  (r) , and  increase  r by  1 . Set  NSTG3 (s)  = r. 

(iii)  Set  NSTG2  (t)  = s,  a = s and  j = NSTG2(t+1).  Set  i 
= NSTG 3 ( j)  and  increase  j by  1. 

(iv)  If  LSTG  (i)  is  even,  set  LST3(r)  = [ LSTG  (i)  / 1 0 ] , 

where  [a]  is  the  largest  integer  less  than  cr  equal  to  a, 

and  increase  r by  1.  In  either  case,  increase  i by  1. 

(v)  If  i < NST  G3  ( j ) , go  to  (iv).  If  NSTG3(s)  = r,  go  to 

(vi) . Otherwise,  increase  s by  1,  and  set  NSTG3 (s)  = r. 

(vi)  If  j > a,  go  to  (vii) . Otherwise,  increase  j by  1, 
and  go  to  (iv)  . 

(vii)  Set  i = NSTG3(j-1). 

(viii)  If  LSTG  (i)  is  odd,  set  LSTG  (r)  = [ LSTG  (i) /I  G ], 

and  increase  r by  1.  In  either  case,  increase  i by  1. 
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(ix)  If  i < NS  TG3  ( j) , go  to  (viii)  . If  NSTG3(s)  = r,  go 
to  (x).  Otherwise,  increase  s by  1,  and  set  NSTG3 (s)  = r. 

(x)  If  t < max  ( 1 , N - L)  , go  to  (xi)  . Otherwise,  decrease 
thy  1 , and  cc  to  (iii) . 

(xi)  If  LSTG  (r)  has  been  set,  increase  r and  s each  by 
1,  and  set  NSTG3(s)  = r. 

(xii)  If  I i S - 1,  go  to  (xiii) . Otherwise,  set 
NSIG2  (t)  = r for  t = 1,2,... , (N  -L-1)  . 

(xiii)  The  procedure  is  complete.  STOP. 


Example  E-6 

Problem:  Store  the  left  subvectors  in  ISTATEm2  order  for 

the  case  that  N = 2,  N =2,  L = 3 and  ALFA(1,1)  = 0. 

1 2 

Solution:  (Steps  in  which  nc  variable  changes  value  are  not 

listed. ) 

(i)  NSTG2  (4)  = 1;  NSTG3(1)  = 1;  r = 1;  s = 2;  t = 

3. 

(ii)  (Use  Algorithms  1 and  2) 

LSTG  (1)  = 1122;  r =2 
LSTG  (2)  * 1212;  r = 3 
LSIG  (3)  = 1221 ; r =4 
LSTG  (4)  =2112;  r = 5 

L STG  (5)  = 2121;  r = 6 

LSTG (6)  = 2211;  r = 7;  NSTG3  (2)  = 7. 

(iii)  NSTG2  (3 ) = 2;  m = 2;  j = 1;  i = 1;  j = 2. 

(iv)  Since  LSTG(1)  is  even,  LSTG  (7)  = 112;  r = 8; 
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1 


^ . 

(iv)  LSIG  (8)  = 121;  r = 9;  i = 3. 

(iv)  i = 4 (LSTG  (3)  is  odd). 

(iv)  LSTG  (9)  = 211;  r = 10;  i = 5. 

(iv)  i = 6. 

(iv)  i = 7. 

(v)  s = 3;  NSTG3  (3)  = 10. 

(vii)  i = 1. 

(viii)  i = 2. 

(viii)  i = 3. 

(viii)  LSTG ( 1 0)  = 122;  r = 11;  i = 4. 

(viii)  i = 5. 

(viii)  LSTG  (11)  = 212;  r = 12;  i = 6. 

(viii)  LSTG (12)  = 221;  r = 13;  i = 7. 

(ix)  s = 4;  NSTG3  (4)  = 13. 

(X)  t = 2. 

(iii)  NSTG2  (2)  = 4 ; a = 4 ; j = 2 ; i = 7 ; j = 3 . 

(iv)  LSTG  (1 3)  = 11;  r = 14;  i = 8. 

(iv)  i * 9. 

(iv)  i = 10. 

(v)  s = 5 ; NSTG3  (5)  = 14. 

(vi)  j = 4. 

(iv)  LSTG  (14)  = 12;  r = 15;  i = 11. 

(iv)  LSTG  (15)  = 21;  r = 16;  i = 12. 

(iv)  i = 13. 

(v)  s = 6;  NSTG3  (6)  = 16. 

(vii)  i = 10. 

(viii)  i = 11. 

(viii)  i = 12. 

(viii)  LSTG  (1b)  = 22;  r = 17;  i = 13. 

(ix)  s = 7;  NSTG3  (7)  = 17. 

(x)  t = 1. 

(iii)  NSTG2  ( 1 ) = 7;  a = 7;  j = 4;  i = 13;  j = 5. 

(iv)  i = 1 4 . 

(vi)  j = 6. 

(iv)  LSTG  ( 17)  = 1;  r = 18;  i = 15. 
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(iv)  i = 16. 

(v)  s = 8;  NS1G3  (8)  = 18. 

(iv)  LSIG  (18)  = 2;  r = 19;  i = 17. 

(vi)  j = 7. 

(v)  s = 9 ; NSTG3  (9)  = 19. 

(vii)  i = 16. 

( viii)  i = 17. 

(xiii)  S10P. 

3.8.  ALGORITHM  8:  DETERMINATION  OF  RELATIVE  POSITION  OF  A 

FAR  SUBVECTOR 


Algorithm  8 is  for  determination  of  the  relative 
position  of  a far  subvector  among  all  far  sufcvectors  which 
are  valid  for  given  right  and  left  subvectors.  MAX  is  a 
vector  which  gives  the  maximum  values  which  the  component  of 
the  far  subvector  may  take  on.  That  is,  the  k-th  component 
of  the  far  subvector  can  be  no  larger  than  MAX (k)  . 

Throughout  the  algorithm  n is  used  to  accumulate  the 
relative  position  of  the  given  far  subvector  and  k and  m are 
used  to  direct  control  of  the  algorithm.  Recall  that  MAX  (k) 
= 1 by  convection  if  there  is  no  job  corresponding  to  the 
k-th  component  of  the  far  subvector.  This  will  be 
illustrated  in  the  example  following  the  algorithm. 

Algorithm  8 

(i)  Set  n = 1 and  k = 1. 

(ii)  Set  m equal  to  one  less  than  the  value  of  the  k-th 
component  of  the  given  far  subvector.  If  m = 0 or  k = K,  go 
to  (i v)  . 
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(iii)  For  i = k+1,  k+2,  ...,  K,  multiply  m by  MAX(i). 

(iv)  Increase  n by  m and  k by  1.  If  k < K,  go  to  (ii) . 
Otherwise,  n is  the  desired  number.  STOP. 

Example  E-7 


Problem:  Suppose  N = N = M = 2.  Further  suppose  that 

1 2 

each  queue  has  a single  server  and  a FCFS  queuing 


discipline.  Finally,  suppose  that  the  service  distributions 
are  two-stage  Erlang  distributions  for  type-one  jobs  and 
three-stage  Erlang  distributions  for  type-two  jobs  at  each 
queue.  Determine  the  relative  position  of  {1,2,3}  among  all 
far  subvectors  which  are  valid  for  a left  subvector 
{1,2, 1,2}  and  a right  subvector  {0,1}. 


Solution:  Since  there  are  no  jobs  at  PP 1 , MAX(2)  = 1 ty 

convention.  Since  a type-one  job  is  in  service  at  PP2 , 

MAX  (2)  = 2.  Since  there  is  a type-two  job  in  service  at  the 
CPD , MAX  (3)  = 3. 

(i)  n = 1 ; k = 1 . 

(ii)  m = 0. 

(iv)  n = 1;  k = 2. 

(ii)  m = 1. 

(iii)  i = 3:  m = 1 x 3 = 3 . 

(iv)  n=1+3=4;k  = 3. 

(ii)  m = 2. 

(iv)  n = 4 ♦ 2 = 6;  k=4;  this  is  the  sixth  far 
subvectcr  for  the  given  left  and  right  subvectors. 

(Note  that  the  first  five  are:  {1,1,1},  {1,1,2}, 

{1/  1,3}  , {1,2,  1}  , and  {1,2,2}  .) 
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DETERMINATION  OF  STATE  NUMBER  OF 


B.9.  ALGORITHM  9; 

VECTORS  KITH  A FAR  SUBVECTOR 


I 


Algoritho  9 is  for  determination  of  the  state  number 
from  the  vector  representation  of  a state  when  that  vector 
representation  has  a far  subvector.  This  algorithm  uses 
KSTG  (in  which  the  right  subvectors  are  stored) , LSTG  (in 
which  the  left  subvectors  are  stored)  and  NSTG4.  NSTG4  is 
defined  by:  NSTG4  (i)  is  the  total  number  of  states 
preceding  the  first  state  having  KSTG(i)  as  its  right 
subvector.  Throughout  the  algorithm  i indicates  the 
location  in  KSTG  at  which  the  current  right  subvector  is 
stored,  j indicates  the  location  in  LSTG  at  which  the  left 
sutvector  is  stored,  it  indicates  a location  in  LSTG,  and  n 
is  used  tc  accumulate  the  state  number.  The  meaning  of  MAX 
is  given  in  the  discussion  of  Algorithm  8. 

Algorithm  9 

(i)  Let  i and  j be  the  integers  such  that  KSTG(i)  is  the 
right  subvector  and  LSIG(j)  is  the  left  subvector  of  tne 
given  state.  Let  k be  the  smallest  integer  such  that 

LSTG  (k)  is  a valid  left  subvector  for  the  given  right 
subvector.  Let  n = NSTG4 (i)  . 

(ii)  Form  the  MAX  vector  to  accompany  KSIG(i)  and 
LSTG  (k) . If  k = j,  go  to  (iv) . Otherwise,  increase  n by 
the  product  cf  the  components  of  the  MAX  vector. 

(iii)  Increase  k by  1,  and  co  to  (ii)  . 

(iv)  Use  Algorithm  8 to  determine  tne  relative  position 
of  tne  far  subvector  of  tne  given  state  among  all  far 
survectors  which  are  valid  for  XSTG(i)  and  LSTG (j)  . 


Increase  n by  this  number, 
number  of  the  given  state. 


The  value  of  n is  the  state 
STOP. 


Example  E-8 


Problem:  Consider  the  system  discussed  in  Example  B-7. 

Find  the  state  number  for  the  state  whose  vector 
representation  has  right  subvector  {0, 1} , left  subvectcr 
(1,2, 1,2}  and  far  subvector  {1,2,3}. 

Solution:  KSTG  = {1,  10,  2,  11,  20,  3,  12,  21,  30,  4,  13, 

22,  31,  40}  and  LSTG  = {1122,  1212,  1221,  2112,  2121,  2211}. 
Each  left  subvector  can  be  used  with  each  right  subvector. 
Although  all  fourteen  values  in  NSTG4  could  be  determined, 
cnly  NSTG4  ( 1 ) is  needed.  The  only  states  preceding  the 
first  state  having  KSTG(1)  as  right  subvectcr  are  those  with 
all  jobs  at  the  CPU.  From  LSTG  it  is  seen  that  three  of 
these  states  have  a type-one  job  in  service  and  three  have  a 
type-two  job  in  service.  The  feasible  far  subvectors  for 
each  left  subvector  are  {1,1,1},  {1,1,2}  and,  if  a type-two 
job  is  in  service,  {1,1,3}.  Thus,  NSTG4(1)  = 3x2  ♦ 3x3  = 

15. 

(i)  i = 1;  j = 2 ; k = 1;  n = 15. 

(ii)  MAX  = {1,2,3};  n = 15  + 6 = 21. 

(iii)  k = 2. 

(ii)  MAX  = {1,2,3}. 

(v)  Ey  Example  3-7  the  relative  position  of  the 
far  subvector  is  6.  Thus,  the  state  number  is  n = 

21  ♦ 6 * 27.  STOP. 
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B.10.  ALGCFITHM  10:  CALCOLATION  OF  STATE  NUUBEH  FOB 

STATES  WITH  EIOCKING  SUBVECTOB 

Algorithm  10  is  foi  determination  of  the  state  number 
from  the  ISTATEml  or  ISTATEm2  vector  representation  when 
this  vector  representation  includes  a blocking  subvectcr. 

As  usual,  KSTG  contains  the  right  subvectors  and  LSTG,  the 
left  subvectcrs.  NSTG4  (i)  is  the  number  of  states  preceding 
the  first  state  having  KSIG(i)  as  right  subvector.  In  this 
algorithm  i is  the  number  of  blocking  subvectors  associated 
with  the  given  rignt  subvector,  and  j is  the  position  of  the 
given  blocking  subvectcr  among  them. 

Algorithm  10 

(i)  Find  the  integers  r and  s such  that  the  right 
subvector  is  KSTG  (r)  and  the  left  subvector  is  LSTG(s)  . Let 
t be  the  integer  such  that  LSTG(t)  is  the  first  valid  left 
subvectcr  for  KSTG  (r)  . (In  the  case  considered  in 
subsection  3.8  of  Chapter  II,  t = 1.)  Let  k equal  the  sum 
of  the  components  and  m the  numoer  of  nonzero  components  of 
the  right  subvector. 

(ii)  If  k * N - C,  go  to  (iii) . Otherwise,  set  i = 1 
and  j = 1 . Go  to  (iv)  . 

(iii)  Let  b be  the  binary  number  which  corresponds  to 

m 

the  (shortened)  blocking  subvector.  Set  i = 2 and  j = 1 + 
the  decimal  equivalent  of  b. 

(iv)  The  state  number  is  NSTG4  (r)  + ix(s  - t)  + j . 
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Example  E-9 


Problem:  In  the  case  that  N = N = C = 2 and  M = 3 find 

1 2 

the  state  number  of  the  state  whose  ISTATEml  vector 
representation  is  {2,  1,  0,  1,  2,  1,  1,  2,  1 , 0,  0}. 

Solution:  In  this  case  KSTG  = {2,  11,  2C,  101,  110,  200,  3, 

12,  21,  3C,  102,  111,  120,  201,  210,  300,  4,  13,  22,  31,  40, 
103,  112,  121,  130,  202,  211,  220,  301,  310,  400}.  Note 
that  10,  for  example,  is  not  included  in  KSTG  since  the 
number  of  jots  at  tne  PP 1 s can  be  no  smaller  than  N - C = 2. 
Also,  LSTG  = (1  1 22,  12  12,  1221,  21  12,  2121  , 2211}.  For  tne 
state  given  the  right  subvector  is  {1,0,1},  corresponding  to 
KSI G (4)  ; the  left  subvector  is  {2,  1,1, 2},  corresponding  to 
LSTG  (4)  ; and  the  blocking  subvector  is  {1,0,0}, 
corresponding  to  a binary  10  or  a decimal  2.  Since  the 
length  of  LSTG  is  6 and  since  the  first  three  right 
sutvectors  have,  respectively,  one,  two  and  one  nonzerc 

1 2 1 

digits,  NSTG4  (4)  = 6x(2  >2  ♦ 2 ) = 48. 

(i)  r = 4;  s = 4 ; t = 1 ; k = 2;  m = 2. 

2 

(iii)  b = 10;  i=2  = 4;  j = 1 + 2 = 3. 

(i v ) The  state  number  is  48  + 4x(4-1)  + 3 = 63. 
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IR3EEUCIEILITY  AND  PERIODICITY  IN  CENTRAL-SERVER  MODELS 


In  this  appendix  irreducibility  is  exhibited  for  a large 
class  of  central-server  models.  The  technique  is  one  cf 
indicating  a string  of  feasible  transitions  from  an 
arbitrary  state  A to  another  arbitrary  state  B.  In  this  way 
it  is  seen  that  the  associated  Markov  chain  is  irreducible. 
In  addition,  the  periodic  nature  of  many  central-server 
models  is  examined. 

Consider  a central-server  model  (Figure  1.1)  consisting 

of  a central  server  (gueue  M + 1),  hereafter  referred  to  as 

the  CPU,  and  M > 2 other  queues,  hereafter  referred  to  as 

PP1,  PP2,  ...,  PEM.  Suppose  that  there  are  I job  types  and 

that  for  each  i = 1,  2,  ...,  I,  there  are  N >0  jobs  cf 

i 

type  i circulating  in  the  system.  Then  the  total  number  of 
jobs,  N,  circulating  in  the  system  is 

I 

N = 5 N 

" i 
i=  1 

For  each  i = 1,  2,  ...»  I and  each  j = 1,  2,  ...,  M , let  p 

ij 

be  the  branching  probability  of  type-i  jobs  to  PPj  after 
completion  of  service  at  the  CPU.  Since  the  network  is 
closed. 
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a 

Z P. 

j-i 


for  each  i = 1 ,2,  ...,  I. 

Let  & and  B be  any  feasible  states  of  the  system. 
Denote  state  E by 


B - (b,b  , ,'d  ,u  ) 

12  N 1 M 


where  (as  in  Chapter  II)  n is  the  number  cf  jobs  at  PE j in 

state  3,  and  the  subvector  3'  = (b  ,...,b  ) is  a 

1 N 

permutation  cf  N ones,  N twos,  ...,  N I's,  such  that  the 
12  I 

first  n^  components  of  B'  list  the  job  types  cf  jobs  at  PP 1 , 

the  next  n components  list  those  at  PP2 , and  so  forth.  The 
2 

last  n = N - n - ...  - n components  of  B'  list  the  job 
c i a 

types  of  jots  at  the  CPU.  The  subvector  of  3'  corresponding 

to  each  gueue  should  represent  the  job  types  of  jobs  at  that 
gueue  in  an  order  of  arrival  appropria te .to  the  state  E and 
the  queuing  discipline  at  the  gueue.  For  example,  suppose 

n^  = 3 and  PEI  contains  one  job  each  of  types  1,  2,  and  3. 

If  PP1  has  a ES  or  IS  queuing  discipline,  (b  ,b  ,b  ) can  oe 

1 2 3 

any  permutation  of  (1,2,3).  However,  if  PP1  has  a FCFS 

queuing  discipline  and  the  type-2  job  is  in  service,  the 
type-1  jot  next  and  the  type-3  job  last  in  state  3,  then 


(b  ,b  ,b  ) must  be  (2,1,3)  . 
1 2 3 


323 


It  is  easily  seen  that  the  representation  given  above 
may  not  be  unigue.  However,  uniqueness  of  representation  is 
not  important  for  the  proofs  which  follow.  State  A can  be 
similarly  represented.  But  this,  too,  is  not  important  to 
the  following  proofs. 

Theorem  Suppose  that  the  CPU  has  a FCFS  queuing 

discipline  and  a single  server,  that  all  queues  have 

infinite  capacity  and  exponential  servers,  and  that  ISM 

and  the  queues  can  be  numbered  so  that  p * 0 for  i = 1,  2, 

ii 

...,  I.  (that  is,  jobs  of  type  i are  allowed  to  route  to 
PPi.)  Then,  the  system  is  irreducible. 

Consider  arbitrary  states  A and  B as  described 
above,  and  start  in  state  A.  State  B results  from  the 
following  sequence  of  feasible  transitions: 


1.  Cne  at  a time  route  ail  jobs  at  the  PP's  to 
the  CPO. 

2.  Cne  at  a time  route  all  jobs  from  the  CPU  to 


-t 

the  EP's  sc  that,  for  each  i 

= 1,  2, 

. . . , I , 

all  type-i  jobs  route  to  PPi 

• 

For  k = 1,  route  a type-b 

job  from 

PPb  to 

k 

k 

the  CPU.  Repeat  with  k = 2, 

t he  n k = 

3,  and  so 

forth  to  k = H . 

Now  route  the  first  n joos 

1 

to  PPI, 

the  next 

n jobs  to  PP 2 , and  so  forth 
2 

, leaving 

the  last 

n jets  at  the  CPU. 

c 


Corollary  C- 1- A 
multiple  servers,  cr 
gueuing  disciplines: 


Theorem  C-1  still  holds  if  the  CPU  has 
if  the  CPU  has  any  of  the  following 
IS,  PS,  LCFS,  LCFSPE . 
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k. 


££22.l:  Tbe  sequence  of  events  given  above  will  w 

each  of  these  cases  (with  obvious  changes  in  arrival  o 
at  the  CPU  in  step  3 for  LCFS  and  LCFSPR  queuing 
disciplines) . 

Corollary  C- 1-E  Theorem  C- 1 still  holds  if  the  C 
a class  priority  queuing  discipline  provided  the  PP's 
chosen  sc  that  the  queuing  disciplines  at  PPI,  PP2 , .. 
are  IS,  ECFS  or  PS. 

Proof : The  sequence  of  events  given  above  will  w 

each  of  the  first  N - n jobs  routed  to  the  CPU  in  ste 

c 

immediately  routed  to  the  appropriate  PP.  Step  4 is  n 
needed. 


Corollary  C~ 1-C  Theorem  C- 1 still  holds  if  the  v 
queues  have  generalized  Srlangian  service  distribution 
each  queue  has  either  a FCFS,  LCFS,  IS  or  PS  queuing 
discipl ice . 

££22J:  To  the  sequence  of  events  given  above  add 

5.  Advance  each  job  in  service  to  its  appropriat 
stage  of  service. 


Note  that  many  ether  corollaries  are  possible.  Se 

of  these  should  be  obvious  to  the  reader.  For  example 

generalized  Erlangian  service  distributions  are  possib 

with  LCFSPR,  LCFSPHpt  and  class  priority  queuing  disci 

provided  strict  attention  is  paid  to  the  order  of  arri 

jobs  and  advancement  of  jobs  to  the  proper  stages  of 

service.  Also,  finite  capacities  are  possible  provide 

...»  PPI  can  be  ctosen  so  that  the  capacity  at  PPi  is 

least  as  large  as  N + a . Rather  than  consider  detai 

i i 


erk  in 
f jobs 
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can  be 
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further  corollaries  to  Theorem  C- 1 , consider  the  following 


L 


theorem. 


C^2  Suppose  that  the  PP's  can  he  numbered  so 

that  p * 0 for  i = 1,  2,  I.  Further  suppose  that  for 

il 

each  i there  is  a j * 1 such  that  p * 0,  and  that  each  of 

ij 

PP1  and  CPU  is  a single  server  FCFS  queue  with  infinite 
capacity.  Then  the  system  is  irreducible. 


Proof : Again,  start  in  state  A.  State  B results  from 

the  following  sequence  of  feasible  transitions: 

1.  One  at  a time  route  all  jobs  at  the  PP's  to 
the  CPU. 

2.  For  k = 1,  route  the  job  in  service  at  the  CPU 

to  PP1  if  it  is  of  type  b . Route  it  to  PPj 

k 

fcr  seme  j * 1 and  then  back  to  the  CPU  if  it 

is  net  of  type  b . Repeat  this  procedure  until 
k 

EP 1 ccntains  exactly  k jobs. 

3.  Repeat  step  2 for  k = 2,  then  for  k = 3,  and 
sc  forth  up  to  k = N. 

4.  One  at  a time  route  all  jobs  from  PP1  to  the 
CPU. 

5.  Route  the  first  n jobs  to  ?P  1 , the  next  n 

1 2 

jobs  to  PP2,  and  so  forth,  leaving  the  last  n 

c 

jets  at  the  CPU. 

As  with  Theorem  C-1,  many  corollaries  can  be  stated  and 
proved.  Rather  than  doing  sc,  simply  note  that 
irreducibility  of  the  three  models  discussed  in  Chapter  IV 
as  having  been  programmed  is  assured  by  these  theorems  and 
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their  ccrcllaries  provided  there  are  at  least  two  PP's  to 
which  jots  can  route. 

Theorem  C-3  If  all  service  distributions  are 
exponential,  each  state  of  the  resulting  Markov  chain  which 
can  be  reentered  is  periodic  with  an  even  period. 

££22l:  Consider  a sequence  of  states  resulting  from  a 

feasible  sequence  of  transitions,  beginning  and  ending  with 

the  same  state:  3=A,A,A,  ...,  A , A = B.  It  will 

012  k-1  k 

suffice  to  shew  that  k must  be  even. 

Define  a function  f from  the  state  space  into 

the  set  cf  nennegative  integers  by: 

f (A)  = n + n 

c b 

where  n is  the  number  of  jobs  at  the  CPU  in  state  A and  n 
c b 

is  the  number  of  blocked  servers  throughout  the  network  in 
state  A. 

A transition  from  A to  A can  only  take 

3 j+1 

place  when  a jcb  completes  service  at  some  gueue.  If  the 

job  cannct  meve,  the  server  which  was  servicing  it  becomes 
blocked;  i.  e.,  n is  increased  by  one  and  n remains  the 


If  the  job  can  move,  and  if  no  server  was 

blocked  because  of  the  finite  capacity  at  the  queue  at  which 

service  was  just  completed,  then  only  the  one  job  will  move. 

Because  cf  the  structure  of  the  central-server  model,  the 

result  will  be  either  an  increase  or  a decrease  in  n by 

c 


one . 


The  value  of  n 

b 


will  remain  unchanged. 
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If,  on  the  other  hand,  the  movement  of  this 

job  "unblocks"  a server  at  another  queue,  two  or  more  jobs 

will  move  simultaneously.  Because  of  the  structure  of  the 

central-server  model,  each  of  these  jobs  will  move  either 

toward  the  CPU  or  away  from  the  CPU,  resulting  in  a change 

of  one  in  the  value  of  n for  each  job  which  moves.  (Since 

c 

seme  of  these  changes  are  positive  and  others  are  negative, 

the  net  chance  in  the  value  of  n is  no  more  than  one  in 

c 

absolute  value.)  For  each  job  which  moves,  except  the  jcb 

which  completes  service  to  initiate  the  transition,  a server 

is  unblocked,  decreasing  n by  one.  Thus,  the  change  in  n 

b c 

♦ n is  ere  fer  the  job  which  completes  service  and  either 
b 

minus  two  or  zero  for  each  of  the  other  jobs.  The  net 


change  is  therefore  odd. 

Since  the  net  change  in  n + n is  odd 

c b 

matter  what  the  circumstances  of  the  transition,  f (A 

j 

must  be  even  if  f(A  ) is  odd,  or  odd  if  f(A  ) is  even 


3 3 

Considering  the  sequence  of  transitions  given  above, 

is  even,  f (A  ) is  even  for  even  j and  odd  for  odd  j. 

J 

f (E)  is  odd,  f (A  ) is  odd  for  even  j and  even  for  odd 


3 

Since  A = B , f (A  ) = f(B).  Hence,  k must  be  even, 
k k 


nc 


) 

+ 1 


if  f(B) 
If 


Since  the  author  is  interested  in  steady-state 
solutions,  tte  principle  concern  is  systems  which  contain  no 
absorbing  states.  Thus,  the  following  conclusion  to  Theorem 
C-3  would  be  more  to  the  point:  "the  resulting  darkcv 

chain,  if  it  contains  no  absorbing  states,  is  periodic  with 
even  period."  In  some  cases,  as  is  seen  in  the  following 
theorem,  more  specific  results  can  be  derived. 
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Theorem  C;4  If  all  service  distr ibuticns  are 
exponential  and  there  is  a feasible  state  B such  that  the 
CEO  is  idle  and  some  PP  has  cnly  one  type  of  job,  then  state 
B has  period  two. 


Suppose  that  PPj  contains  only  jobs  of  type  i. 
Then,  if  a jcb  completes  service  at  PPj,  the  system 
transitions  tc  a state  A identical  to  B except  that  there  is 
a job  of  type  i at  the  CPU  and  one  less  jcb  at  PPj.  Prom  A 
the  system  may  transition  back  into  B if  the  job  at  CPU 
completes  service  and  routes  to  PPj.  (Note  that  the 
branching  probability  of  type-i  jobs  to  PPj  cannot  be  zero 
since  state  E is  feasible.)  Thus,  the  period  of  B is  no 
larger  than  two.  Ey  Theorem  C-3,  the  period  of  B is  even. 
Thus,  this  period  is  two. 


The  importance  of  Theorem  C-4  is  guickly  seen  for  acdels 
which  also  satisfy  the  hypotheses  of  Theorem  C-1,  Theorem 
C-2  or  one  of  their  corollaries.  The  result  is  a Jlarkcv 
chain  of  period  two  since  irreducibility  is  also  provided. 

Generalizations  of  Theorems  C-3  and  C-4  are  possible  in 
certain  models  with  nonexponential  service  distributions. 

For  example,  if  the  CPU  has  two-stage  Erlang  service 
distributions,  and  if  all  PP's  have  exponential  service 
distributions,  the  period  is  divisible  by  three.  On  the 
other  hand,  aperiodic  states  result  from  many  generalized 
Erlangian  service  distributions  (since  the  job  may  complete 
service  at  any  stage)  or  from  Erlang  service  distributions 
with  relatively  prime  numbers  of  stages  at,  say,  different 
FP's. 


329 


LISTING  OF  FCFS  PROGRAM 


OOOOOOUOOUO  OOl-lOUOOUOUUOOOOUOOUOOUOUUO 

OOOOOOUOhhh  — » , — i-— *-*»— ir'imi'K’lronimr'iri'T 

ooooooooooo  00000000000000000000000000 


iIl.IH.lll.Il 

iiiiiiiiiiiiiiiiiiiiiiiiii 

LJ 

2 

1 

<J> 

•» 

•>UJ 

CNJ 

LL-  P— 

w 

LUO. 

<* 

Oh 

Li. 

LJt/> 

-J 

H-4 

< 

LL 

<► 

LJLL 

LJ 

oo 

2 

C\J~< 

LJ  2 

CL  LL 

*— I ► 

•—•O 

0.0. 

^4pg 

LO  *— * 

22 

II 

zon 

•>  ^ 

—4 

WUJ 

UJ2 

03 

LL|~ 

21  UJ 

il  il 

U II 

UJ<1 

•-•3. 

OO 

— ICL 

LJUL 

t — I 

LL  — i 

O •* 

LJ 

II  o.<. 

II 

oo 

♦— »cu 

—“'O 

o 

II 

•*  ► 

p-  Q- 

h- 

LL 

-*r\J 

rvjw 

CO 

lulo 

ww 

P-UJ 

LU 

*: 

a cd 

<< 

'-OOOp— 

LJ  O 

— * 

LL  IL 

0.  UJ 

f^J< 

—«  X 

OO 

X 

-JO 

^-PJ)L0 

LJ  LU 

zu 

X 

<1< 

UJ 

Xv/l 

P—  (_J 

z 

D 

p—  •— »l/) 

UJ*. 

LO  2 

•» 

*— « 

•*  ^ 

LUf—  2 

O •* 

2 ~ 

LL  •* 

m 

t/jt— »LJ 

«.  •* 

<r 

• 

DO 

o*-1 

hhGQ 

LU  2 

LL  LL 

CL 

0.0. 

iZ)*— P— 

*.r— « 

p—  a 

U-l 

LU 

OO 

CL  JJ< 

— •»  w 

<1  O 

< 

CD 

•>  » 

u«o 

OLU-* 

H*  2 

2 

21 

hUO 

vOP~*-i 

to  ►X 

OLL 

O 

It  M 

OQOi 

(7»<  w 

— • LL  2* 

— O 

—y> 

>■  ii  i 

LU  QC 

mKd 

- LU  ^ 

LO 

► •» 

OQ.UJ 

wCOI— 

— «LU  0 2 

zz 

2: 

O 

2o<-o 

CLP-  0021 

LU  LJ 

UJOOCM 

♦— M— 4 

LULU  2 

LJ  ••:* 

P—  *■  •*<! 

2--« 

CD  JCL2 

#•  •> 

o-*  • 

•«*—  t/iaou. 

►— * tr> 

a CD  LU  - 

f-*C\ J 

<<1  -J 

2C0-~ 

OJL/AQl  *»Q_  -J 

02 

Of  LJP— — 1 

P-P— < 

^"70.  •HUO‘< 

LU  CD 

CL  CL  QC  LU  2 

LULU 

LOL/IOJ 

• •20H- 2 

II  500 

200-21  •> 

P—  H- 

-5ujw^h 

1— <P—  ~0<  •‘UJ 

►^CL 

•U— - <CL 

<< 

UJ  LU  UJ 

0.00- 

OLcL 

III 

cr  <j)o 

i •.p-;r0ooQa.< 

O 0 2 

X<Z 

P—  *— P— 

mh-h-p— 

ZZZZZOX 

AJ  2 0 

II  — OCL 

— * O 

'-l/)w')VJ\  VNNNSN 

2 — 

o~«  — 

• 

1 — 1—  P— 

^‘-•z.Ka'uuuju.oJ 

— ' P-QfN 

a.  o •»2fn-^ 

■t*  ooo 

fNJZZZ 

v'^Q.Orvja'O'UJUU-* 

uiO-niLnn 

unHH02^HMH0OO 

Z2ZZ  JJJJJJJU'O 

ioll'O  — ri  o*-»aona. 

ofcjrnc 

U uj 'U  au  cd  aj  cc  m aj  <j> 

II  M II  ••  « 

— * IQ.  p-4^HCU  II  IP 

0.0.0.  ii  ii  ii  ii 

SNSNWSJ.^ 

1 -w 

. C 

2 - 

tOCOt/)L/1 

ZZZZZZZUJ 

u_i/>  I ii  irv—  o— •—  ujirvt— 

mmp— lull— «C  OOP—  CD  a. 

zc^zcajuouuoiuucaci:  i — «io*iu<irw« 

II  ww<lh-lilZhUH<  JQm 

lu  tu  oj  uj  2.  x a.  2-  31 2:  2.  uj 

UOU  | CL— l2L 

—t-s:  un 

(003-<U 

p— <iaL  2 

2- 2.  jl  3_  3. 2. 2. 2. 3_  2. 2.  p—  u.u-)tL  f Uj^a 

— «(X  M.LL^<i  <iULP—  LJ 

II  OOLULLLO 

LJUULJUUUZUUUU  ••U.w-'LJLJULLJ  ••  'AJLJLLUJUJLJVP^ 

*•  O.O.ULLL 

ooq  00000000*^222  2P-U‘Zu-Lj.XLLp-acLi-Lj  a.  clu- 22  2.1— 

ZL 

2 

2 

1U  ‘M 

Hai  pi 

o 

UJ 

4.  LJ 

Ji  Q 

o 

2 

3.  O 

02.  O 

o 

2. 

o — 

>TLJ  — • 

fU 

U 

OO 

O 

ooo 

330 


BEST  AVAILABLE  COPY 


UOUOO'JOUUQOUOOOOOOOUOO'JOOUOUOUUOOUOUUOUUOOOOU'JOO 
—mjrri'Tin'or- uou'OrH<\im.i-m.or-ooo'0-*c\jo.rin45r‘-cc<j'0'-i<\jmorin-or'*'50cr'tj— <c\jm-rm43t— ao 
%r  <r-r-'r<r'r  <r-T 'Tin  in  ui  in  u\ in  in  in  in  in -0-A5  43  45 'O'-u  45  4545  r-i'-r'-r-r-- r- 0500000303050150305 
ooanouoooooooooooooooooooooooooooooooouoooooonoa 


<1 

r— 

h— 

II 

oo 

oo 

M 

t—t 

M 

•» 

» 

'■n 

UJ 

LU 

o') 

o 

1 — 

H- 

a. 

^"4 

<1 

•— « 

h“ 

h- 

u 

00 

LO 

— - 

1— 

z 

z 

a 

LU 

o 

— 

*“■* 

a. 

o 

LU 

o 

o 

a 

oO 

o 

o 

o 

— * 

<J 

a 

o 

o 

• rC| 

at: 

m 

X 

o 

<\J  — 

og 

*-o 

at 

o 

a. 

•* 

► 

a. 

— <• 

vOM 

•o 

• 

o 

z 

z 

3.0 

z 

o 

a 

UJ  —« 

UJ 

2LI- 

UJ 

1 — •“ 

•— • 

2 

+ 

*-  H- 

-*  X 

w f— 

*— 4 

— #o 

u 

<1  LJ 

Q1  LTN 

IU  LJ 

cc 

*— cxo 

oo 

— a 

X 1— 

h» 

J - 

1—  r-4t— 

cX3 

CD 

H- 

— Z -1 

LO 

43 

< Z 

o 

a 

X — 

-J-*  z 

— 4-  - 

— * 

3315303-  "5 

ao 

<*C  —4  1 

-4  •* 

Z.l/1  X ^ 

z -< 

0.0 

CD  • 

— • 4^-4  zr<MCMa.om 

LL> 

• — 

►X  O XCL 

5:x  • 

►-•CJt -ZZ 

<11- 

*—  —4 

^.CLLU^l 

t— 4 

Ht— *LJ 

*— • II  IIH  II  ||  II  H—  LJ 

< 

UJ- 

II  •— U.-^ 

II  «-  ioj 

l-O  • 

4-  y- 

t 

Z II  II  II  o o+- 

oc 

• •* 

II  ^ 

z • 

-j^zy- 

o i 

+ i-i- 

->N51  — — + — — — z z 

y-  xo 

— (M—  ^ 

^5Ii- 

L-J  9CL4L  • 

»— • QC 

>— 4»— « ►—«*—*  ►— « 

LJ*£.  II 

<3.  rvjn  O v- 

*>-a 

zzc 

o ii  ii  a — wii  n «-* 

II 

| 

II  1—  O II  XX 

W | 1- 

JC  CD  II  O 

• CQO  O 

^ ^LUUJ  *£  fNiOJUJrn  UJ 

if  M 

43m  00-3  r-i  i-uj  i/i 

h-  ii 

II  < 

II  XX'JJfNi-l"  ~vj ►—  h—  °\J  1—  UJ *— • II 

Ul-sl 

Q.<UJCMI-X^  xcu 

i—  i.a 

-JZ-> 

»-z 

II  II 

LJt-J  ~4<l  < IJ  ^4<1<1^4<U.|— 

ii  oou.qc  ii 

^2.h--niU  II  UH  ii  II  < — • 

— 

XZ^  I—  r—  r-t—  r->ux 

^ OL 

1— <1  II 

r—  II  -w 

<m.U.I-U.iOStL-<lM«— “"••Ul'I'/li  Ul,''/IUI/lI-f-**40UI->"-)lLUUUl/)'-'  u. 

u — ' i •—  Z — Z 2 U •->  — I -I  a.  X —I  I—  a — • 5t  i.  1-J  •—  X ( J — • ~5  Z S.  Z Z Z 50. 1_)  —I  •—  U.  105  Q —>  — I A.  A.  Z LJ  A JL.  — 1 JL  — i 


LU 

(N  n» 

>r 

LJ 

U\>u 

r-au 

a. 

"j 

l\l  ^ 

>J 

O 

ogivi 

rvjcM 

2. 

a 

o 

^-4 

LJ 

CM 

*— 4 *— 4 

BEST  AVAILABLE  COPY 

331 

«| 

jJ 


ooQOuooyooooooounuuoooouoououut'uoowoououuoooouoo 
j*  o —«\j  m >j-  m -u  r-  oo  tr>  o — u-g  m «r  m <o  r-  oo  ip  o — < < \i  m ■#  u > <0  r~  uj  o'  o *->  f\j  m -t  xi  r"  00  o'  o —>  pm  m -r  ir\  0 

jQW'^^u^U^^^^u^^OQOQUOQUOO'H^'H^.  «—*:>grg(\)rgigrgi,gr\irgcgcOrrii'MrMfr)<MrH 

OO  OOOO  O O OO  O 3 >-4^4  •— l^,-4— 4— 4 — l-J— 1— 4—4  — 1— 4 — l-J— 4 — 4 — 


3 

a. 

u 


z 

a 

h- 

*— * 

< 

1 

►— 

JC 

> 

*— 4 

300 

*— 4 

*• 

CL 

LJ 

LJ<1 

'■S. 

X 

••a. 

— * 

<x 

— H- 

— >T  Z 

2l 

Z~ 

(NO 

w 

<T  _|r-4  | 

UJ 

OJZ 

cn  •* 

h— 

KO 

— »^-«LJ  CO  —• 

< 

X-* 

-J  1 — -J 

H— 

»-►- 

O - r 

CO 

cO<I 

►— *-^Cj  lu 

*»« 

u.aaaH  x 

vO'-'Cj 

oil  nt>  >r  no  -n  < 

* 

UJ 

mujuu 

OG^H^nm  ro  21 

ro 

O' 

1— 

— OO  Z -*  -* 

h- 

4»  — 

>r 

*N 

< 

<UJ 

►-«  ^4  — •O'-'LJ  — < uj 

►— < •— « 

►—  i—4 

Ol 

O^U 

— -<LL^0KUJ»-0  >— 

UJ 

CJ 

w H- w 

LJ 

X 

^UJ  ♦ UJ  — CLI  LJ  <1 

LL 

H- 

UJ  QUJ 

u 1 

»-  O 

+ 

+ < 

< 

»— ♦—  +cx  »o<o  »—  »— 

> 

— * 1—  UJ  1 — h- 

u 

z y- 

a -j 

2: 

a<— 5:  OUJ— * OQCOOZ  21  co 

1— 

O 

— X. 

h“ 

OK< 

— 

Kh^DHOQu.  JDQD“5 

Z 

J5 

— 2!1— > 

1^03 

*■  * ^ 0 

-J< 

<0J 

UJ 

ZlO— iZLU^^uj^  11  ^ 20^ 

JJ  Z v/)  H-  *— * v/) 

303 

a.— o-mc 

— ‘CL 

h- 

•.—  w O Oh-  — •*  ll  1 

— < II 

h-  *J— 2ICL*-4 

OZ  — 

> 

u>u 

<1 

^ UJ  II  LJh-  — UO^U^  II  — 1 

UJ-»  11 

• aj  — 

+ — ' 

• *— •*— 

b- 

11 1—  NoaNh-u.i-a  0 — 

J « 

• 

H-  II  l»  II 

1-0 

0 tl  i-o 

O 

0<->< 

CO 

II  <f-»Z  Ot2^2Z-^  • II  X 

X 

O 

(-0  u II 

c 

< «x 

llj  a: 

-»l—  <S>  0.^-^  »0  • *1/}UU  <X<  1 

rsiiu 



y-ujcoi 

11  •—  t—'-fo.  11  uu  • iioiz  a— «W)_j  11  iuuxuuuuj-ij-s.<i5:  ro  • u MM^MHHi/ijjfn 
o i/iixia.  ziTlit—  — oi_mjuj’>g  u.j'-  t wX  — ul— 1 3<-3i—  11  w— 4 -»q_— 1 • — — < 

t— CP'-'  • i-zai- ai  z-*iu  am .o_jo  •«£  • •aiiinai  ai_i  a.  at  r— luujcclliz  xai 

I,  <c\J  _J  II  <t—u<0  II  a»  mt—  11  >-ujivi  .2_j-*_ji/)t—  zjctii—  11  1—  CIO  II  Ujrot-1—  fit—  1131-0 
ol<-h  11  _j  xi-zi  a 11  ~><i  <iuzaHjii 1 _i  «3.  <a  11  ►—  11  u.-<»a«s  — «a  11  ^.<1— 

A ^ — x.>^.w.»  X A I— a.1— ai  — _i— ■— IUJ  — —1— ■—  rAh  — 1 X f-  1—1—  I—  A.  — r— 

<1— y_ju-<«uiLi-»"^l-‘iMJi/i  Ji/ifNn.«ixu.u‘X.u-^IU-Uni<lwiviUU.<l-ir-ui/Jwiuwiw' jamu 


i-  LJ  LJ  -J  ~ 1L  C-J  0 »-•£-)  f—  >-  .i.  — j LJ  “?  Z “>  ^ W ^ 

z 

U' 

UJU 

•MINI  l'l 

NT  U\ 

ui  ii  r* 

UJ 

LT 

t>4 

5CHI 

rr>  0 1 < « l 

Ol  Ol 

«»»  "i  r*» 

r») 

m 

u 

0 

*— 4 *— i 

r*H 

r»4 

BEST  AVAHABLE  COPY 


332 


MC  CCEFINZCOEF)  = ALFA  (M  TYPE  f IS  - M * P AT  E ( M TY  F E , C PU  ) / C I V R A~l 
l A 1 JSTATE(LS)  = NUM 


oguouuouoouoouooooooouocjuouoouooufjuuoooo'-'ouuoono 
co  cr»  o — * <\i  m >r  in  >o  p-  oo  lt  o — c\j  m >r  .n  o r-  cd  o'  o — « <\j  .n  «r  in  >c  r^>  co  cr  o ^ <\j  m «r  m o r**  oo  o'  o ^ r\j  r > >r 
r 1 cr)  n v »r  'T  >r  >r  >r  >r  >r  >t  >r  u ' m u i u ur\  m u un  u \ir\  gj  gj  >o  o o «o  4j  >o  no  gj  n-  r-  r-  r-  cu  oo  uo  uo  go 


ZZZZZiZiliiiZZZZZZZZZZZZiZi 


LU  X 

o -o 

O Q- 

r»*4  *— « 

2 


XfNJ-  * 
CO— •LJO' 
«•  »uj*— 
-CM-  ^ •» 

Z>~  lH- 
O.  —/IUJ 
O-  ►—COLO 
►CO  — • 

r\J— *COI— 
w jJCOl/1 
LUI/)QIX  UJ 
V~— — V— 

<[  <3  u-<l 

QLULCN4  h- 
►UJ  wUCO 
-^XLL’i 
3U.Q.OLL 

a.*—  >-oo 
uacf- 

•*OJ  h-Cfc 
p— i-fc-a.  u»uj 
— CJOLCO 
UJ  LL  •— 2. 
F-OQCLLO 
<■  LU  2 
a jCodco 


— * 

► ^ 

U-£UO  < 

x a. 

UJZZDK 

i Q 

UJ— »-  CL LJ 

1 

II  2 

02  •‘OV- 

►—  • 

N*  X - 

LU 

2 HOH  •* 

I— 

-X  X 

< 

— <>T  • 

tUGCfNJ*  in 

V— 

"■**— »aj 

V—  — 

cO 

X *** 

>o 

in 

<1  - >XN 

z 

— UJ  • <x 

vT 

C\J 

h-  ••—  rom 

— * 

- CHh 

kvO<  *^vO 

o 

2 

2 ^O 

21— CO-  U- 

Cnrr, 

U 

o— ••  2: 

Q 

a 

• ••  LJ 

rnr-  c\ji— 

o 

t- 

h-O 

(MO  lull 

f^*<x 

2 

ii  -*voq: 

o 

2 10  2 

CU-  Z? 

— #o 

Q 

o-< 

cO 

— * 

OV-IUOC-# 

II  >JJ 

• '—r\i  • 

O 

coo 

— LLlQ-J^ 

— ^ 

f-  Uh-LU 

►U-— «LL. 

»— 

rg  u 

2-J-5Q- 

x uj 

UCJ 

X < -TUJLULU 

— <• 

••co  — •</; 

<iuxv- 

O'OrMOUJ 

21- 

-^a  *o  *uj  ^ 

mUJ 

| 

a-O—O-J 

O 2'JO 

►o-  o 

Q- 

>ro-o 

•rr 

CL  ( x cO<X 

r^>£h- 

— z 

-*z 

- — r;uJ>—  + 

^M>0 

02 

UJ 

2Q.UJ— 1(^ 

3UJI—  ^OQ 

—a  n 

—4 

a.  + Zt— ♦—  x 

2 2 ~*h- 

•— *W 

1— 

• Q.ULU 

rv-2-Z  — 

h—  • ^ — J 

• •— 

• — m • ■ 

<-5CX 

- 2X  — 

Q — 

< 

— • ►>  X 

l <1  3L 

Ol-^  •< 

UJ)— 

— « i-T  *2 

zu 

V— 

sTXh-Ul. 

4-H-  H H —^h-'J'UUJOJ 

ii  -a-  Osji—  • -h 

i h- 

CO 

OO  2 — 

c/1  1! 

3 «KZ 

loooin  >z  u o z— _io 

1 

2 

— <0  — ‘LL*— QC 

X-J—  — 4- 

• Q-<I 

■U  CN|  — v-SJwLU 

• ~ — J *«• 

— <x  — 2 *UJZ  + 

2^ 

CNJ'VOOLU 

<t 

lu^— h- 

^tnuj 

IIAU  *■ 

-X  *2 

2 NUJ  It  C-/ 

II  *-X  UJ  Q. 

<2L  II  ^ — *CO_|2'0<I— < <sU^>OwU  CUE-  n O X^'—l  OOO  2 II  -—3  — « O— 'OC  -J 

X 'Jj(\JUJ  J »CO  — I— wV“OUJ2cO  ^TIZXuj  — 2— « II  2 ll  ZUJ  H—KvUOf- 

II  JJV— -TV—  i/ja^aa.  (/)uj<iuj<t *sih-— « — iX  «T  i-iu-O  ujo^^—O^CLlkxcu*  < 

ii  u.<i  — «.  )i  o—* 2— • it  <:f-lHZc<au  o ii  — * m u •a  2x20  n jaF-i-^r-unzi  •*- 

X >-►—  i—  *cr  *— 0.*— v— w u r—  ii  ’*»■■* ■— ■ i u.^  2*—  uj»—  qlja  •> 

2<lr-^'LJV)C’IU_LLOu*-  ••  AO.LLUU.UU.'/iO.  -tAUA^V/  U.l^lLU^Ul-UUVIU^aLU^UIX 

1^:— I— xll  — 2~ — .222x^020—  -*ul-  — »co 
lM»*l  •—  UJ  — < i\ji\jn  )>T  a*  ^ O >r  'T 

>t>t  x r->  or^r^sr  >r  >r  cj  uuo 


2 

UJ 

iv4T\4nt>r 

X 

rJ 

uNf^sr 

o 

o — ^ 

o 

'VJ 

<>4 

o 

best  available  copy 


ooucuoooruuouuoo'joooo'jo 

ajuotuujoou'a'u'j'y'^u'u'w'U'ouoooouo 

—I  rM  - 4 ^ — < —I  — < —I  —I  H —I  ■_)  —I  (\|  C\J <\i  C\)  (M  (M  <\J 


OUOUQCOUOOOOUOOUOOUOOO 

i \j  r<  i in  .0  r-  ao  o'  o — < (\i  o -r  in  -*j  r~  cc  o'  o — < 

OUOUUOOOO><^H«rtHHp4HHI\JMI\J 

OOOOOOOOOOOOOOOOOOOOOO 


oooooouooooooooooouooo 


• 

X 

U)U> 

X 

unu 

SOiQ 

•-•a. 

• —lUJ 

*- 

^ ► 

V/ 1 UL  UJ 

o 

X*-*> 

ZHU 

wo 

X 

— •-  o 

— • 

QZX 

X 

z 

nr 

z 

lOUJUJ 

U 

— 

l-X'V 

Z 

<1 

X 

•> 

ujuvt 

X 

UJ 

cm 

(XUC.CC 

Ul 

o 

^CO 

iuo 

Z 

z - u 

UJ 

— >4 

0»"0 

u. 

zz 

_J 

</} 

— in 

-J 

*- »OU- 

OJ 

*— •— *i\| 

-£ZO 

*— 1 » 

LJ 

•» 

LJ 

J) 

UJ 

■— * 

— jllx 

Ul 

H- 

Z-JX 

Z 

J LJ  HI 

CD 

<1 

<!*—>• 

Z 

LJ  CD 

X 

Z 

X(D*— 

•» 

u_xz 

— « 

1— «*• 

—4 

UJ-J 

X 

z 

UJ  *“ 

oiqjx^ 

LJ 

*— • 

VUUX 

<1 

li-  rr> 

LL 

-J 

j-a.  o 

U 

H-U  — *< 

UJ 

*—  a.  ► 

-J 

zx  - 

<L 

• 

LL-  O- 

»- 

z 

•» 

O ^-1 

< 

UJ 

— 

— » 

X\V) 

o 

X 

mQ* 

Z 

aujoino 

CD 

i 

z 

ujz— *^uj 

*— 

luu  > 

► 

CXLJ'V  — UJ 

u 

Ul 

— z-«  < 

cm 

tj  in-  o 

X 

<1 

LL  <1  | 

— 

ZCX-«  X 

z 

X 

*—  01  UJ  | 

UJ 

►VJ  -1/)UJ 

zojx  i 

l • 

a 

LOUw  - CJ 

— 

UJ-  > * 

*— 

CD  lUoQ 

LU^ 

— 

•» 

•*-  • 

X -O 

z 

OQ(^UJ- J 

IJ' 

*— 

—4 

UX-  | 

► • 

(X 

“)IUCU< 

h-  ** 

o 

—4 

CL'O  - | 

— e\j 

ex 

o>iuxx 

r\l 

►CM 

► 

UJ— «X  1 

Z — 

2— iUJUJUJ 

AJ 

— 

^ ->Q  1 

ZUj  CM  00 

-J 

-cu  x 

z< 

wO 

Z-  mm 

• OO' 

-J 

U-LOXXO- 

ox 

<*»— 

-J 

L JLO-  •» 

—4  X —4^ 

< 

LJ  UJ«-«»-» 

UJ-J 

X 

< 

ZLLtulX 

o 

cj*-  acex 

l<r 

oo 

X 

H-CEin 

LU^  OCJ 

UJ 

— o •*  <1 

lo 

UJ 

'X<Uw 

l—  nT  *-»- 

□ ZUJ<  CL 

OQ  -*  u-  o 

*> 

X 

ua“)c\j 

< * 

Z 1-21 

<iuQ(\a  — j 

X 

•» 

X-«  QLJ 

•>X  <1  LL 

oo 

CX  •■—  OO 

CXUJI-ZQ 

••  -z  r - h- 

► • 

X 

aJO  oaz  - 

O _JlOO 

»— »— r\j— 4 *.  «4jj 

^Hin 

ZUJ 

D— «UJ  • 

— > 

ZJ  *—iX 

DD-ZnDh  O 

x—  • 

zx 

2I>Q_CM 

- a.  — o 

—4 

v— 'LL  K UJ 

acjLu  -ix<  o 

X<UJ 

otc>— i— •">a— ■ • • 

• 

^a.Ofc-*33 

ZXI-ZZOX 

ZiD 

^-4-^ 

Z UJ*—  LJ 

U\-  —4  s^UJ 

UJ 

gj  LL 

W — 

-o  • 

O'X 

oO  • ► II  O ►— 4 JJ  Z 

UJ 

C-  XZ-J 

UX^OXOU  -4 

z<f^ 

1 oo 

-J-  **X 

ox-*-»  • • 

-j  *j: 

o -uj<i  z 

UfoO  • 

o— ♦ 

< ►X‘n2CMOCM^X*-Ctuuao<MXcox- 

Z 2JJJJU  UJ 

axvc\ 

r—  X >U'^-el  *•—  ^N^QH/JUU'J’  ►ini.h-  ••uj 

I—LOVJ  3JOJ  -j 

IIX* 

■JJ 

XU-  -Xk 

0"*J  •rsj 

vO  — 'O'—  X (J  oo  X o 

XU 

1— x^>VX'^  • 

<o 

rri^Jinzz  O'- 

►—CM*  ►'^wK'^Hi/)£DOQ»< 

^H*-ZLUOiT 

Z3l</1Z-£Z2UJ  3.H-1I-I 

-5  Z 

W*- 

• Sl/)* 

Cuj<uj<u.< 

ex 

CjUJ<  - U- 

UHZUUQUU  II  X 

<» 

a — 

O M H uj< 

-■^aiU 

~<*-Xr-Z~  — 

— i'-*  -j 

1— *-JL  *H—  N*-  LL 

U.  LUXX21XLLJ  Z 

II  CM  O 

H r— *- 

1-  *— Z 

^ j>uu. 

— ILL  — UL  ww 

-j'— -j 

^ILX  •*3’ Z LJ L_1 

uj  a.2.ii.a.raj- 

II  — ' 

z 

_)U-i— CL 

lj—»  •;uuixuu-uuLu.<iu.«iuuuo^.*-<ur"^ 

— / ••►^UL-'UUL<llL^U  U.Z'JOOLLXULCJ 

Vir-UULMJLWH- 

X LJ  LJ  — 

jlouuoz  -«U_ 

'T-n^r- 

— ^CM^) 

z 

— — • 

eg  hj  ju  lj 

UJ  O 

IM 

»'*  VJ' 

OLJ  J"J 

*.  in 

W 

-HO 

-40  — *rvj 

X 

O 

CM  <M 

cm 

LJ 

O 

o 

8ES1  AVAllABLt  COW 


334 


1CHEITS  JOSS  FROM  USING  IT . OThEP  PER IPhERfiLS  MAY  BE  RENUMBERED 


uoguouuoooounouoouoonouoouoouooouonouoo'jouoououu 
rn 'T  in  aj  ^ o ^ eg  ro  >r  ir\  o ^ co  c/' o ^ > >r  u > >o  co  ^ o ^ (\i  ro  in  ^ r- a?  o' o ^ f\i  rn  m o go  c' c-j 

<n  c\j  eg  i\4  c\j  rg  m n » rn  m n m o » n > ro  >r 'T  >r  >r  nt 'T  >r  sr  m u > in  u'un  in  u \ u un  u > ^ ^ >o  o ^ 'O  r- 

OOOCJOOOOOOOOOOCJOOOOOOOOOOOOOOOOOOOOOUOOQOOOOOOOO 

UUUUUUUUUUUUUUUUUUUOUUUUUUUUUUUOUUUUUUUUUUUUOUU'J 


3 UJ 

- J UJ 

X 

• 

ZZ~ 

zz  — 

CO 

II 

UJI— 

UJI— 

l/)UJM 

z 

a. 

•— 'CU  _J 

MlUJ 

CL 

J-  — • 

X — * 

LJ 

z 

|— 

r- 1/7  CD 

- 

- <3.<. 

z 

oO 

► J.  OJ— ^ 

o 

X o- 

X LJ- 

*-4 

0</’X  • 

UI//Q1  • 

h- 

1- 

^4CDQ_cO 

^CDCLcO 

LJ 

3 

N(J  OJ 

x) 

X 

a. 

U'-JUU 

UOOU 

X 

ZC 

X 

HH 

-CM»-4 

►HM 

u 

- ic\j 

- X *— • 

LJ 

• 

COXO 

OQUJO 

oo 

<0-ZUI 

<ro.zuj 

o 

-J 

_S>-<  CL 

2><d 

<1 

h- X ->■ 

1-  QC^- 

CL 

co  cur- 

U)  ^31- 

Ui 

CJLL 

CULL. 

X 

-L 

ljcjljx 

ouax 

o 

CL 

-?  ^c  LJ 

o za 

X 

•-4 

o£<lU- 

CXCCL 

X 

x 

~*UJ 

pguj 

X 

UJ 

comuj 

CQCOLU 

CL 

UlZ!UOO 

UIZlToO 

z 

0.31—0 

O.  3*— O 

•— « 

X 

>z<x 

>2<  X 

-S 

*-  Xh- 

1—  QCh- 

O0 

1— 

UJ 

UJ 

•—4 

ILXUJX 

X XXX 

f— 

o 1 — OH- 

CJH-LJ^ 

1-0 

cO 

*— 4 *— • 

X 

< 

c£0>3 

C£3>3 

o 

UJ 

3Z0: 

!JU2ZOC 

CQ  <3  UJ  LU 

CD<JUj 

Z 3Uj 

s:  i^u; 

X 

-4*-*  H- 

Z>»-«  OC 

:d— i ex 

a 

+ + < 

Z LUO  — 

z ujo 

— • 

33 

Cl<  3 

CJX< 

o 

X 

x cl  uj 

►— »—  H—  Q- 

►—  h- H- 

X 

X 

— '— IUO  •> 

3-3  l_> 

3 - O 

o 

CO 

+ + ^ <1 

XQ  - 

xo  •>»— 

— » »> 

X 

->“3-4rg  — « X 

43  ZUJX  -5-?(M 

>0  ZUJX 

• 

3 

U 

- 

m-iOOQ  - •*— ' 

^ M(JCU 

► — ' w 

zL 

h- 

lUJXP— Q ►— 

*£!  *-JX  rgiMUJ 

zC— UJ 

>~4  ~4UJ 

H-O.CO 

C ULK-'.O  w— b- 

O ^<^3 

wl — 

LU 

a 

IU<<<C  CL  — J 

M-.XX-  Z iJ<<X 

t-(MXI-  z 

ai<< 

3 

o 

Q-»-U.Q£a;OCZZ 

ro  ZMO  • <f  Q.I — Ll_  oc 

o z*-o  *<I 

Q.I-U.X 

H- 

CL<  _l  3 - 

-<Q  - r-*. L X<X 

(NiO  • r-4  X 

Q-<  3 

• 

— • 

2TQC<  II  II  — — ‘ - 

- Z!  O ^X<X  M 

►<3~  “Z  O 

2X<  11 

— * •» 

ox 

— ‘ (MXUJ/-  - 

>r  nixoj>- 

•> 

>TX 

r 

••zil  II  -*-1^00 

^^OOUJCUZ  —*w*  II  ||  — . 

OOUJdZ 

4 II  |l  -• 

oo 

Ml  33  * *0-< 

•*C\J0'-*CXJ  UJ  Z> 

^CNJ  O «— 4 CD  x 

3 

o— 

— X a.  U UJ  >o  >• 

— « « 0 ^ C2CU  I II  — *X 

<r  •vo^v  cjx 

1 II  ——.CL 

>0^ 

_J 

•»  H 

•“''sOOCLI  GU  nuo 

—I—  ►NI/)Uj(U 

”3^L JCJ 

• 

»«•»>•  «v£w  —4 

_j  -G  — i/i  mi  ► « ►in 

— 4 — 5 » ^ HvQw 

a.  -5  ►-*  ~ ^ <\j  x x 

— X<I  ^—4C\IZ  — 

Z CM<M(M 

— H- 

CL 

^w^wQ.a.Uj<-.  || 

^<\JLU<  UJ>  Z (N«w«-CNHUJ<  X>  *£ 

in^wwij  ii  lljc 

>r  >r  ^ < uj  uj  z »—  a.  o 

zC  X X LL  «L  II  II  *-*X<lXI— <Hi»— XXX<1  II 

II  — 4UJ<lUJI — 

■w 

►-  a.  »—  w »-•  ex.  — * uj 

— 'xxox.  ii  >— uur— 

WWHU.UJUX  <1 

eu.h 

CD*-HX 

u-LJLJ**  — a-U^^UA-^UCUkiJiU  *-«  c>guJ<i_j<4.LJU-a_CLi_;CX3LU  im 

^ X «4.  LJ  <3.  X LJ 

t_H  1UL<1  ,Y  ULMI-*  < LL_  ►*— * 

i-.  ^ a_  ^ cj  co  ^ ^ lj  ex  <1  ul  LJ 

^^XU.5I^v)Z^.4lUa.«i.iiu^'XLL 

1 

—4 

—4iMcn 

^(NrO 

nT^  u>ou 

0—4  im  CM 

m'O’  rn 

Ul  l 

'v  >r 

>r  o 

— 4*«4  O (-4 

LJ 

mm 

^ LJ 

o 

o 

o 

O 

<0 

o 

SO 

•c 

BEST  AVAILABLE  COPY 


335 


MC 


unouoounououuoooouooooouoouoooouooooouoooouoouoo 

.^cMfn>rtnof^ooo-*<Ncn>t-in'Of**cO(J'0'*^r\jro>rin'Or“»co(7'0— 4cgo>Nj'ingjr>-aoc7'o,^f\i<'r>>rin'4jr'»aj 
i^r^i^i,»i^r*p'r^(^cuajvu<wcD®cOcoajflD(jNy>g>y'y'y'V'j'^u'UCOOOOOOUO^H^^MH»H^H 
O O o o O OO  OO  O O O O O O O O O o o UO  O O O O O O O — »— < -4  — * —i  ~4  —4—4  — * —4  —*  —4  — I — ♦— * —4 

UUUUUUUUUOUU'JUUUUUOUUUUUUUUUUUUUUUUUUUUOUUUUUUUU 


c n 

> 2-U 

«— 4 

UJ 

H-OUJ*-^ 

M 

X OJ 

^Qdh- 

••X 

h-  «*0 

o:  — <i 

» » 

• o 

u-»oo 

in 

X 

u.^ai- 

UJK-* 

□ouu 

XUJM 

a.  j- 

0.1-0- 

in  ocm 

U >- 

UJUI 

r— 

UJ»- 

►-4UJJJI/) 

X 

CCO 

1— »— QC— « 

cn— • 

□ JOO 

*—<□1 

a 

Jh*UH 

xx 

-»-L 

—*v; 

u 

- h- 

CO  QC  CL 

'0<3 

► UI 

<l^UJU 

-4^cn 

OJmUU. 

*—*x 

WMQ 

a CL 

h- 

•»t—  LL 

«z 

— 

• •— « 

Q_  J JUJ 

JU! 

in 

L/HS) 

u •— 

•“•St 

UJ 

UJUUJ 

(Jl/KJI- 

CL  U.*— • 

<11— 

H- 

*-<QL<x<x. 

CD 

•— 

H-U*-« 

x ^ 

o<n 

-J 

*L-J 

o>-  ► 

QC<1 

»— 

<X  *— • 

zuoouj 

XX 

(O 

<CQ 

<1 UJUJ  o 

<1 

u < 

CL^L^CD 

oz 

CO 

□ XCD 

CO*— «*— *U  'T' 

zo 

u 

OO 

— Ih-  f\l 

l\Jf\J 

CL 

>a:a: 

UJ  LJ 

XI- 

LL 

m 

H-U.U- 

OLU^UJ-*LJ 

U<1 

UO 

INJ 

>— * 

UUO^-  1- 

z^ 

H-h- 

u 

JUU 

LwQLM  • 

z 

O 

~U'Z 

^ — IH-U 

QCX» 

CO 

►—4 

CDO*— 

oc  a:<zo 

aD<  • 

oo 

X 

<zi 

Ul/)UJ*-*UJ 

2-0 

o 

o 

03^0 

-400^  — 

ajcciicco 

— — 

z 

o 

QIZ 

UJXZUJUO 

XUUJIM 

nOvO 

< 

0CU< 

ZKUQ.-4  • 

1— Z*^J 

* -* 

<X 

— i 

cl  a: 

a jmuLm 

uj  O 

♦ * 

a j 

o 

ZCO 

x • 

IL£L*L>— 

-4—4 

• 

OUI 

• -<UJI— 

u < 

u 

• • 

UJ 

in 

ZUUUJ 

•*C>  -i 

xo 

OO 

> 

r-  • 

*— »aOX 

Z’ach-  uj  . 

X #1-0 

— 

* * 

•— « 

-#■  h- 

— 4 X H- 

CJlu— • •ac— i 

D- 

mm 

»— 

* vO-J 

oo^) 

— «rvl_j>-LJU 

o ►a*'^ 

•> 

• • 

i\j  •rvj  • 

•-4C  <Xh- 

1—  *-*1X2.  • 

sUuiO 

— 

O 1 

O 

— O -« 

x<x< 

Oinm<  ooui  •>—  t 

• • 

UJ 

ooo  o HCU 

►a:  X 

<m<^U,'2 

► X r\j<in 

< 

XH— H- 

z 

• •>—  ► tt(-  " 

-ICG-  H- 

*-^o  oinco<x< 

— r^LLJ  *XX 

CL  OO 

» 

OO  — CL 

1-4  • » 

• OClU  • 

• XQCI-  Q 1 

<\J 

z • « 

— — 

-•o  ^ ooa 

(_)—  >HO 

— ■ ►coacejuo- 

— ► ►o  JZ< 

•» 

•— *** 

U)X 

o -a  *o  *u  sux^-m— * 

r^xuxujx  •*lix-  • ► 

H 

OO 

II  II  X _4  O 

if  oo  ••  • 

OOT  Z3ITOC  LOfw^ 

II 

*•  ► 

O-i 

— -J  —CL 

| 0—4*  •>  • 

O •— 4 ► O 1 1 

II 

II  »-»*-4 

— o <r  r oo 

■•vO’SilX'U 

o^-  x^"5  •'O'V—  <*•  ll 

— 

— • 

^■w 

►>xCT 

• >*  >r  ui  • »oi  ►,'xu.o^:cr»  *-n  «»o<-  *— 

►x  i-  • 

“>vj'  Qj 

• i~*0 

“5  <3  <J  — ^ nO  W m 

•*  •'OOfM  <^J  + DUO^ 

• ►sQ w *-4(-jojvOw— 4— * X *0'0W'^  JC“5 

• • 

U LL 

wl— 

>^>— <UJQ_  f— o*v 

^HMShX  •* 

-»♦—  coin— 4 

uJU'OO'f  JJ  nuu<0 

W-^  HJOlOUM  • • 

— UJ<(—  •0UQUJ<  — O— «UJ«lO-  * r» 

— O II  (_) 

U«M 

‘>*<< 

'lujj.  >-  i—  (-nil 

M <t— X *r-t- 

■ f—  2-  • LJ‘-/) X “)  Kj"l^h  h- 

^4.  II 

ll  — 

D’-'UL 

wL.r— -w  ii  it  ii  w— • 

— «uc  ir-x^' 

— *u-  x-^ 

va.  aj 

-*-U 

UU-u.<ia.ijU-i<lvi.  ui  XJ  y_j  u-  ■— « ia.i  jtiM2.ua.  l„j  ujlu/  ■ ll.Xxj*  U»^u 

— "-J  <3.  UJ 

UU> 

-,^lLU<l(t'-i4U4.UUUUMM' 

jcu  — -uxu-u 

^cxjiM 

— rg 

XJ 

—4  IM  t»l>X 

air-  >4j 

CO 

r**  x 

IM 

o 

IM  iM  'MINI 

u 

cgw  i>4 

O 

CM  "4 

o 

O 

O 

u 

>u 

'Ll 

>o 

BEST  AVAILABLE  COPY 

•H 


J 


ouoouooucun 
^ o *-•  rsi  m - r m su  co  cr 

^<N040vjv\4PsJ'\JCsjrsJ'\j('g 


UUUUUUUOUUU 


II  II  *-• 
UJ  '-*L 


•"N. 

-4>Qw 


2 1-22  ~ \-z 

II  UJ<lX 

l-niiMah-J  »— 

Z LJ 

CJLJLJU-UjUJ«4.  LtLJUJrfl 
J.UJ 


nQOOunoooouocjuo'-JOuunuooonouoouoouo 
^-4  <\j  m >r  m >o  r^»  ao  O' o <\j  >r  in  >o  co  u' o ^ nj  m >r  m >0  oo  O' o rvi  n 

OO  OOO  l\J(NJC\J  CNJCNJCVJ  CNJCNJ  CNJCNJ  P I P IP^P)  CO 

ooooonoooooooooooooooooooooooooooo 


<a 


02.2 
o <1 
<iu 
1-0 
Q<^K 
<x_joo 
<i  x 


1/) 

CNJ 

(XU. 

>■ 

g 

xqm 

<1 

f— 

ac 

U1 

^LJ  •* 

O 

cx 

Z 

OZH 

1— 

< 

Z 

LL 

-J  Q- 

• 

o 

G 

(Jh 

UJ 

z 

•f— 

O 

.> 

*—* 

z 

1— COUJ 

z 

►— « 

X. 

LJ 

•-•iCLJ 

<1 

»— 

CL 

M 

Z-  ^ 

►— I 

U 

CO 

0 

V) 

JC 

LJ 

z 

XX 

»—  <r 

O 

h- 

UJ 

•“0(0 

CO  —4 

a. 

2 

CO 

2: 

Z-I 

x:  -« 

2 

*— « 

►— « 

H\0 

O 

< 

► 

Q 

<moo 

<S)  0 

z 

H- 

(X  H- 

ex 

LJ 

ll 

^■<1 

LJ 

UJ 

h— 

2-  - 

1—  LJ 

•— « 

LJ 

S) 

H 

1—4  ► 

LJ  LJ 

in 

Z 

JUU 

K-X 

UJ 

ro 

•xi 

CO 

■«— > •» 

►—  H~  1— 

O 

> 

H 

UJ 

OLU 

OOCOCO 

o<— « 

O 

< 

2*1 -J 

1—  IJJ  Vw 

UJ 

i— 

CSC. 

»— « 

oo<x 

00 —l» 

CJ  — 

-J 

LLU--L. 

2 O 

O 

a 

UJ 

< 

w — 00 

C3C 

h-UJ 

CO  h- 

o 

z 

►— « 

C\IO»— • 

2<2 

-%cO 

a 

H— 

Ol—  •* 

zzz 

O U 

Z ZZ 

— » 

• 

►— CO^h 

uou 

H »—«UJ 

i wQ. 

r*- 

1— 

Z 

CO  _JCL 

(Jhmm 

oO'X)U)» 

LJ  + • 

■* 

CO 

1—4 

z -2 

H-OOv^OoO 

II  2 20 

*— • LD  • 

-* 

< 

*m,  — » 

•> 

LOZZZ 

OJI^UJUJ 

iX  — • f— 1— 

IU 

CDUJOO 

f\JQ--JLUUJUJ 

aj  211-i.Lj 

oO—  COLO 

• 

—1 

<XHUOXO. 

<1  *-H  »— «LU 

UJ  •—•*—»  • 

o 

HQ  ► 

2^  HI 

^ HQ  ►OLU 

X *-H 

• 

h— 

H—  UJ 

-OQQQ 

(MQ-UJh-UJZ: 

1—  » -f 

3t- 

< 

♦-DH 

-<^2 

-^f-^2  0C*-'CX 

►00  z 1 

a._j 

m 

«C<'JO  ► 

2Tv/>  II  il  II 

—*  ••  • 2 oO 

UJ  Ihl“  •** 

fMO  • 

ZahKI-Z/2 

ouo.>r- 

■vj  z 2^002  —2 

► 

^X. 

*-«ajcoi/:cn  v. 

NVHUU 

ouz^ljx  xj 

►“•*-4^  ► -ZZZ-  II  H ► 

GO 

OLJ  • ••D'O  Z h- 

0 CNJ  UJ  an 

► 

o—« 

UJt/> 

-H— «h- vJ'O— <*-«0*-* 

< It  | ,-H— • 11  ll  Z*~Z 

2 2 22_j_j_j.—  :x-j 

'-*oo  lj  G-J  cucj  au  a.  a. 
H-  — ■ »— • 

Qh^^^OOU^ 

CL  UJ  LL’  L1J  31  i i. 

OJ 

W ••  •• 

V'^CJL-M-JLJLJLJr— 


II  W — II 

I If  II  • •—  h-^U.  | O^*— * OU-*-« 

*— •.— iCl*™-*  2 0 *—* 

II  OOZOi'-'Kl- UJ22Z^2  »-»CL>— I— 

h- »— u_<tuJ^.cnujH-«ci.»— >o  »-<<N  •—*toP'» 

2:^:^.  _j  o ii  ^ ii  _joo  — 

Ljr-  r—  — if—  r—  — Jt— ^ 

u.  iu. u. Uu  u.  CL  LJ LJ  LJ ►—  UJ  MV»i  Jv^</.'VKU/)li.U 
— ' -* U.  Z l/> OO  CL  h-  Z X UJ *-•  G 2.  2 *-» CJ 


z 

z 

►^rgn> 

z 

VJ'LJ 

—*  U1 

UJ 

>JJ 

CNJO 

UJ  nT 

O 

«MH| 

rr»  rt) 

'3 

X 

X 

ny\ 

X-4 

O 

X 

2 

O 

2 

vO 

LJ 

a 

rn 

LJ 

LJ 

OLJO 

O 

337 


BEST  AVAILABLE  COPY 


oouaounououuoooououuoououooooououuouuouooyouuooo 
un  ^ r^*  co  (js  o —4  cm  m >j*  in  >u  co  cr>  o ^ ^ rn  >r  in  >o  p-  oo  o o — < eg  m >r  m <3  t^»  ao  o'  o ^ cm  m nT  in  vu  r*-  oo  cp  o cm 

r'>rnrr^nirnvT'T^^'T>r>T>T^>Tix\u^u>uAa^a^u>Lnti^'OsO'^'^'0'0'^'^'0'Or^r^r^-r»r^r»i'*f>«f>-r^cococo 

QOOOOOOOOOOOOOOOOOOOOOUOUOOO^OUOOOOOOOOOOUOOUOOO 


cn 

o 


Lt 

<1 

<1 

o 

*.0 


Q 

2 

<1 


o 

t— 

(✓) 


CL 


U 

nOLJ 

t— 

-4t— 

-IU 

-0 

a 

UJ 

ro 

o 

a> 

►— 

o 

■— 

UJ 

ct- 

H 

oo 

o*— • 

o 

1 

00 

oo 

— 

h- 

— * 

•-Jt— 

— CM 

u. 

0-4 

-5  — 

+ 

+ UJ 

O • 

r—i 

-J 

h-  *n 

o o 

— * 

<S) 

— -O  rn 

*— « 

t—  t— 

—•it 

t— lUJ 

r-4  • 

OO  l/> 

W 

• -L 

•CM  —»  C 

It 

2 2 

<M  II 

uut— 

UJ  it  CM  I— 

— — » CM  • 

O 

2 • 

-■» 

it  + UJ 

I— 

• UJ 

2 ■— < • Q CM  — i 1 O 

21  n ► OOO 

oo*-* 

— *»Vi 

►CM  2—4  CG-*Z  O 

*— « 

CsJUJ  #•*-«*—■*-«,-*  it*-*  • 

*-4»— • 

2 •*  M iu.<  ii  ii  ojx 

— • 

w 

CL-J 

—4 

—4 

A.  II  ^ « 11  A.  — • • — 1 JA^^H 

rH 

It  — «fM(M  II  It  —4 

it  cm 

Z«5 

2!X  X 1^0-^  — — -a-^-4 

o 

It  II  U'JU  It  + w 

O 

«*r*H 

+ 

-4 

ii  — a:  cm  ii— • 2:11—4  uj»Q.4'a.-a*C'*i  1 

r— 

—•  I—  t—  t—  vMit 

CO 

'"•f- 

ot^N  -axw  *—  -»  ^ 

V# 

(MCM 

nx“3'-ArJ— 4 CL<l^^awO  -f  Ojf\|33 

20w<M  222  v—  O'— * 2T  *-2:022  nJ2  ojA^x  uj  — «— < Zh  • uj»-«uj.-‘  »it—J 

^hini^O  O'  -w(\u/)^rsjwCto*-*  **  U-*t—  <Mt— + ^--J  co-**-  »—  at  cm 

O ooim  ii  it  it  -•  ii  002  ojo »— 2 tt  ii  it  n H ii  ii  m mo.no  ii  ^ <4.  i«  c ii  ^t  h ii 

r—  ||  r-r—  ►— r-^  ii  r—H-  w ii  it  f—  h-  ••  f—  ii  w wr—  r—  II  •«— 

v/#  i/)V)(j»n^vhjwm/)^iu.  'v/s/ juju-  ••  -^vnjuj  a a X -'V  uu^)  ^ u>  u.^u.t/uiv;x  u-igau 

i£i£.2a£ujat:*',-'LJ'-«:**t*-»at«£A' at  it-J-JA-iA-uj— «a.  A-~at—i 

2 


UJ 


(7*  O 


i^A.  *1 


LJ 

O 


pi 


o » vr 
ni 


BEST  AVAILABLE  COPY 


338 


ooouooooouoooououuoouoooouoouoouooooooounouoouou 
rn  >r  in  r*- oo  cr  o rn  >o  co  o' o ^ c\j  n >r  u > r^- cu  o ^ <m  rr>  in  ao  ^ o rsj  n nt  ^ r*  03  O' o 

CUCDOOCUajajaj(J»(J>U^U^U>U>Cr*U'0>U>CJOOOOOOOCJO^'--»^r-4*— *^pH^»-^»-HfN4C\iOvj(\4PsjrvjrvifNJt\jrvjrr> 
C?  O O CP  o O O o O CJ  O CP  O o CP  O O — J *_4  *-•  «-l  H -H  rH  *-«  —4  ^-4  —4  .—I  ~4  *-<  -4  r-l— 4 —4  —4  »-4 


*— * 

O 

Q. 

h-~* 

Z 

— * 

00- 

•> 

z 

ST 

-Ji- 

^“4 

► 

m 

•— * 

II 

»—4 

II 

— * 

zz 

>— « 

II 

a*-* 

•» 

*— 1 

— * 

—4 

*-H 

«« 

»• 

— * 

-J 

OOZ 

z 

W 

a 

z-4 

2- 

OP 

* 4 

H- 

UJ 

•—* 

■* 

h— 

'T 

0)2:  cj 

cpm 

CP 

<M 

*—4 

00 

a 

1—  CP 

^h 

—1 

a 

0 

H-000 

zoo*- 

/) 

— » 

1 

l 

h- 

vOLU-J 

(X  Zoo 

1 *: 

CM 

Z 

H CM 

—* 

Z-^CL 

3 — Z 

w 

*: 

z - *“• 

z 2: 

O 

0 

0 

« t— « 

h- 

— * 

•» 

2ZXCM  w*-. 

Z 11  s 11  ^4  11 

1— 

CP 

»- 

<i  ^ 

*» 

XLO 

00 

CNJXUJ 

ULU \siA  v^LLlTN 

HH 

1 -i.  II  CM*  1 

^ 1 

2L-I 

1 -1 

U>OCP 

oouzo 

XX*£0 

XX  0 X X 

* Q. 

z 

c. 

CP-*Z 

^0 

♦ + 1 o 

ll  -^IZ  — 

II  <iX^X<IX<l 

(j> 

•f  • + 1 

-J>— • 

os< 

OCMCMCM 

-<CM 

V*  yj' 

Li.  -5  ■**■  «♦•  * CL 

2. 

• rn 

h- 

<r  • 

UJ  • • •»  •* 

CP  •* 

rn  — * CD  ro  f\l  OJ  •— • 

Z~P^  + CJ  X 3 

"3—  I iX^—Zw 

+ OJCO  £)OCMQ.rn  II  UJ, 

— «>0'— 'O 

31—  CPhP'OI—  O 

X_J 

i UJ  *— ii-<3L 

LU  2-  UJ  UJ  O 

-J 

— 1 

—j 

— 1-  ZZJ— 

OfP^ 

'->  u 

n r-v—  *.  * n cot—  S.  ii  n t—  ii  t- 

2.  «0 

CD 

om  • 

II  LU  <X  LJ  iX 

*“ » •UjUJUJZUJ 

i—  ii  ii  t—  ii  ii  it  ii  n<  ii  ii  m<z  ii  <*.  <i  ii  _ji—  ii  — i ii  ii  h-o-j  i—  i„oo«jp— i— >—  h- 
P*  I—  l»  II  X 0-  « x ^l-Ar-  II  — * ^ r—  wtu*— • IX— ir—^1  w*-« I-.HH  ||  •-* 

o^ujLJCDna^i^s^LJu;  -*s  sa^i/ki^ih  u-LJ(lJU.t>JU.uj^>UL.<3.(XCP«4.uiu_AU.QLU.u.  ul 

0 LLCJ*-*.*,*.**.^ 


C/*  O 

m >r 


*— • m c\j  o» 

'T  — 4 J>  — * 

-4  0 ^ 

ft')  —4 


best  available  copy 


ouoogoonoooouooooo 
—*  c\j  <■<•>  >r  u > so  r*  cd  cf  o — < c\i  rn  *j > mj  r-  ao 
m o i m cc\  p » m rq  m m >r  >r  >r  >r  >r  >r  ^ >r 

— « «— 4 «-■<  — < f— 4 >-H  r-H  —4  <—4  I 4 1-4  »— <«— 4 ♦ 


OOUOUOOUUOUOOUOOUOUUOOQOUQO 
^r\jn)>T^vcr^coJ>Or-<o4fn>rm'0^’roc7'C-)^rsjr»'»>ru^>of^- 
O O O O O O O O O -4  .-4  H H ^ —4  — « r \J  (M  C\j  (\|  (\|  f\J  INJ  c\j 

OQO 000000003000000000000000 


I 

I 

I 

I 

I 

i 

i 

i 

i 

i 

i 

i 

I 

I 

I 

I 

I 

I 

— J — 1 — 1 — 1 — 1 1— 1 — I— 

J J J JUU-J-JJ 

— J-J-J-J 

JJJJJJ 

UJ 

•> 

> 

•» 

m 

X 

UJ 

O 

II 

f— 

—-4 

<1 

V) 

H- 

— » 

O 

¥-4 

00 

— 

• 

— « 

UJ 

UJ 

•• 

• 

J. 

LJ 

m 

► 

►— 

>—* 

o 

LD 

¥— 

2 

U) 

»— • 

UJ 

h- 

<1 

•» 

-> 

2— » 

UJ 

m 

*— * 

Jl- 

—1 

LJ 

— *o 

II 

CLh- 

h— 

CL 

2 

<1 

— • 

UJ 

2 •* 

r-^ 

CU 

UJ 

u. 

2 

— II 

aj 

2 

z> 

JL^ 

2 

*- 

u 

iM 

CJJ 

2 — 

i— 

O 

LU  H- 

LU^ 

1— 

h-  O0 

1 — 

h- 

oO 

< 2 

<£>UJ 

*— i 

2 

UH 

2 

OO  -4 

31< 

— < 

*—  UJ 

O.H- 

«• 

LLi  t— 

V) 

-Lw 

“0 

*— * 

(NJ 

1-0  2 

• — 

2 - 

O 

1— 

oO  o';  CO  LU 

02 

— » 

►-— * 

< 

LU— 

n i 

>r 

2Q 

X 

LO- 

1—  **w<4. 

— 

ao 

*• 

2>~ 

oo»- 

— — UJI— 

o 

o 

a _j 

r—4 

»— 4 

►—»*—• 

f\J-J^-4H-00 

— K- 

i— 

jj 

II 

22 

►2 

^Gv<h 

UJ 

•» 

—• 

O— • 

—*•—4 

•XJOH-  •“ 

h-  U 

— — j 

22 

•> 

*— * 

— « 

•— 4_JH“ 

— »<1  O 

VJJ 

— O 

— * 

002 

CL2 

2 <00  -50-1—0 

— o 

| 

o 

►— « 

2 — « 

2— 

►U5C  *“2  <1 1 — 

wOOf\|  — * 

— * 

O^-J 

w 

UJ 

2 Ol 

LU“5 

— — 

02 

o 

-«  XO 

~4«X 

— 5LU  — CO'NJOO  _: 

1-  U 2 

-<x 

>D  CL  •* 

1— 

OQ 

— 20— *2-0  - 

<.  + h-  2 

2 

GLZ 

C/5-— 

1 Qoo 

i-ct 

o.  *— »«-4—  •*  **m 

h-  h“  — 

«f — 

O LUO 

—1^* 

OOUJ^ 

oOQi 

Gh^  UJ^I—  O 

O 

*-  - o 

— O' 

— ‘^o:q- 

2UJ 

iiG-<H2Ch 

hOQOIh 

2K 

t\J  **2 

^ 

• 

CCJ<  -l-o) 

2 Q Oo) 

NO  X 

a.-^  •» 

•• 

UqCI-HZZZ 

-4- 

—0^0^ 

>yaux 

2^XUi 

o\x. 

uojo:u»\nn 

— * iLUiC  • 

2 • 

^ o*-»— » 

020m 

02— «<I  030 

Q.2-H-  •*■— UJ 

— LU 

2 — 0^0 

3^0  — 

fMCNjcgO^ 


■«0-<2 


2— ♦-  — h-  2 

UJ2LLI<I  <1  U£  II  UJ^QU  M UJ^  UL 
y-  r-220  II  »— X^h-  I— 2— »3 

— * ii  ►— «ia_  u-  f— aj  ►— • ll  _j  aj— •ix.'-»t— u 
U_  UL  I— • » UJ  'Vi  ^ < UL  *— • <1  LJ  <120  —*UJ  2 

jC  2 2 2 OL  •—•  •— ' _£2-  O— * _£2— *2  2 


jjlo  2^:*: 
*— '<-oolj2cdco 


^ZO'JJr-1^2 
O^JU 


:x 

O »21 


zoso 

+ SlTi'-viT* 


tl  *L  *r—  it  Oh-x  O • -V  •* 
h- — II  ||  ii/)C  II  II  f^Z^'O'-O 

JX^^ZZZO  II  ||  DZG  ZU  X2— — 
Oh^ZOUG  2 20  -J^IO  2:20— ' •u_i<uj 

QL  UJUJ2X2:  II  Xo^XOSC.  il  2ol--  ||  2o)~  Z.K2I- 
OJ  4.2.2.^.^.  JU  -JO  — — O — O ||  — *— <QL 

*.M^njuu<NJU-Juu-iu.<iu.-Ju^u.-<u  Luu-Ljtx. 
v 1 t—  O CJO O O 2 it  2 O it  2 ^ X •-»  it  O 2 — -X.  O X -*  2 2 Jfc 


UlvJ 

>r 

r—4 

H 

UJ 

n> 

2 

2 

oa 

—4 

VJ' 

LP 

2 

OO 

O 

r—4 

o 

X 

r\jcM 

rO 

rn 

o 

a 

m 


uai 

O 

o 

ITN 


BEST  AVAILABLE  COPY 

340 


OOUOOUOOUOOUOUO OUOOUOUUOOUOOOOUnUUOOOOOQOUOU 

oc  & o -*  cm  cn  >4-  s\  o r*  ou  or  o r*  <m  m >3-  m so  r*  co  v/*  u>  —*  cm  m sr  u ' >0  00  o'  o *-*  eg  cn  in  nq  r-  00  o'  o ^ 
cm  (\j  o 1 m <rj  r»  > ro  m m m m oi  nJ-  >r  sr  'T  >r  *r  >r  >r  >r in  in  in  in  u ' in  in  u * in  >0  <o  >o  >o  >o  ^ 
ooooooooooou>ooooooou>oooooooooou>oooooooooou>oo 


X 

o 

CM 


UJ 

CJ 


UJ 


X 

r^> 


»— 

0— • 


CO 

o 

CL 


II  1—0 

a. 

2 CM 

f— « 

CM 

0 

2;—  •*  •* 

H 

•— 1 

x 

J'UhX 

— * 

a 

in 

o*-*  11  m 

— « 

0 

a 

a 

W 

1— 

h- 

-1 

•h 

CM  •*- 

OO 

LU 

sO 

^-'LU 

•» 

h- 

LJ 

u 

2: 

H 

M XMK 

<1 

0 

0 

0 

ujen  w <1 

* 

V— 

NT 

u 

QVOJH 

r*- 

OO 

— * 

A 

i 

”? 

— • 

rn  O 

fM— 1 

00  0<1 

— < * 

X 

^H  -X 

— 

CM 

^•1-2: 

— • 

i. 

i_ 

a: 

■t* 

h-»-*lOO 

X 

'«-* 

w 

O UJ 

O 

X +*-+r£ 

W 

0 

J> 

1—  • 

>— 

H*  rn 

O-  ***U_ 

O 

O 

Y- 

p— 

CM  •» 

O 

O 

M ■ 

V II  » 

1 — 

(S) 

X. 

1 

00 

j 

00 

SO  X 
^cjj— -*o 

1— 

l/) 

Cl- 

, l>  ! /"> 

x 11 

• r\j  x 

• 

• 

x m*— 1 

-J 

*/  / 

dL 

•*xoo 

UJ 

LU 

XCJO— » 

» 

HU 

OZ 

iOS 

1 

ox: 

X 

OcJiTi  X 

i.  O r-H 

• 

UJ  • 

+ zms 

-t.  • LJ 

0 

1 ••-V 

U’5£ 

II 

X 

vut—  :*: 

•U  « '“N 

X 

M 

CM  l—  ojnt 

UJ  LJ 

HU 

>r  » 11  11 

UJ 

none 

HZ'4jH>w 

moj 

H 

—*  II  | 

h- 

QI 

x *-• 

-*UJZ 

ZUX 

QI 

z. 

• X 

1 -II 

< OJ<l 

O-J 

'U 

x: 

-U2l 

O _ia.o—  *uj<ii_>— 1 

UJ 

UJXCM  UJ 

0 

"f-Z  II 

1—  ^ 11 

1— 

II  ►— l— >UJC\JUJ 

It  — i 

» — *r 

r— — l II 

1—  II 

l-ux  11  r— 

II 1—  II 

ULOJi— .LX- 

w 

UJUJ  LJ 

— ' II 

w II 

II 

u- 

LJO- ill.XUJ^'»u— J—Ji—'— J<C.u.  uXu.  uJ 

u.  '-SLL.u>*-*i_u>2.u>«j»-*  -juj’xujox.xol^ 


o 

o 

•n 


l\J 

O 

o 

in 


\M  Ol  U\ 

*-«  o *"• 

o 
in 


LU  IMOIW' 
"4  I'Jl'J*-* 


BEST  AVAILABLE  COPY 


341 


1 


UOOUOUO^UOUU 
3 CM  n t >$»  m yQ  3 fs»  CD  U>  O 3 
00000000003-h 

unouoooouooo 
xxxxxxx  xxxx 

X 


jo  oo^rngouuouoouoouoouoouoooouoo 

— <<nj  vrir\irurur\vo3  0Q<j>0  3<Njcri>rtn'03aQtf'0  3r\jcn>}*m'-03a>^o 

oo  OOOOOOOOUOOOOUOOUOUOOOUOOOOOOO 

ou  cuououuuoucoejouuoou'juuuucuuoou 


20 


+ 2 

LU 

<1 

3 

<t 

23 

3 

2 

OO 

LL 

a 

3 

• 

LJ 

V)2 

<3. 

— 

2 

UJ 

0^0 

3 

• 

»— « *— i 

OO 

<✓1 

3 

— 

2 

<13 

xo 

O 

2 «u 

~ 3 

U_  3 

3 

<XJO0 

*3 

< 

2Z  LL1 

LOCNJ 

Qt 

JCC 

2 w 

3 

o 

ULL 

3 

3 

► «UJ 

*— • 

a.  a. 

r-LJ 

U 3 

<IU 

• 

3 •* 

► 

CL 

U— 

>r 

LU  • 

lU  O 

*— • 

GDLU 

fNJ 

•» 

JII 

1 1 1 *3 

— * 

• 

3 — 

O'-* 

0 

2 

23 

2'NJX 

• 

»— • 

<1  '—UJ 

0 

LU  <X 

3X3 

0 

3 

X 

<L  OJ2 

— 

3 

33 

30*— 

*»> 

2 

< 

2 - 

— 

*— 4 

00 

3*—  2 

0 

0 < 

LU  — 

X •‘O 

— 

3 h- 

r—  f\j 

1 *o 

— * — * 

3 

02  uo 

NQm 

O < 

3 

00-0  •*  2 

ZH-w 

3 

3 •* 

3 03  13 

w CL 

— 

3 

o> 

2>  rH3  *— 

XU 

O 

O O 

^33 

3^0  3 

30  t 

• 

(3  ^ 

2<3 

320  < 

CJ 

O 

3 

-U2 

'/)U  * — C£ 

2 — 0 

O 

O — 3 

rsa  *u 

03  3 3 

—^3  • 

3 O CL 

233 

32  •*  3 3 

w • fH 

♦ 

• 3 

*2<l 

2 

2 *-3  <4  3 

3in  — 

— 

0 in  ;> 

— <— « :> 

CL 

—•—3  3UJ 

fr  «UO 

•— « 

O • 3 

23  — % — 

3 

33  0<  0-03  3 

—30 

3 O 

'-DDQ^J 

3 3 

U^'OH-  2<  3 0 

XNJ< 

CL 

— 32  0 

3 O rJuJ  2 

LU  X 

OO 

xz  • » 

lU  • 

— rL  uco  -f  - 

2<\i  — 

L/^  rr'  ,*OZNHi/)lll>-nri 

-vNl 

CL 

3 >r—  •» 

U.CU  LX.  3 

o 3 w x ►—<!  ^ h—  uj  •>  — * 

— 2 3 INI  3 

3 

<3  -ft-  ox 

3-t3t\J2 

— * **3 

33330  **<lLO  3 — * 

-<*—  2_JLJtt  — 

*— 

3 * OO 

UI/V33  2W 

03  1 

iuoo  2 < 3 3|—  | 

— o-*  — * 

* 4 

oO  00  3 

2 — o 

• 2 

2 2 3*— 3 lOLO  II  Z 

♦ 2 M OOX 

X 

2—*  •fNJ'v 

<— «i/j  •— • -r  2 

UJ  11  W 

-"/JUOJrN  11  xv)  0 O 

O • •* 

*^o 

• 0 

i — .^*a  — 

3 # 

h—  *—*  >3  ^ *3 LJ  32  • 0 

i’ixo>J^  + Ti-ijnj. 

3 " 

3X^022  *2H<l  0-*Z 

XZ  *2  ^*<  • 

11  0 -JH 

Uh  JZ  3<\j  '-lx. 

QhZO^-H  OO 

30  O OSH  OO 

• O Q_3  < ( 

a.  2:  n 

2 — * 3 

3 012.  3—  — H H II 

f II  11  >T  O II  *— 

H — 

•—  3UJ34.I 

oj  ujr—  ii  it 

— ■ it  r— u 

3 XX  II  X_ 

II  II  11  — *. 

3 

*w>  II  « fY 

-J  «•  -X.  LL.  t \J 

<a-U  LU^L 

-J  t*  *— *V_J  ••  UW,*LJU.X.  A 

02  X O U.U LU 

L4.W 

VJL.  0330* 

1/13  <4022  2 

— I32LI-UJ 

Utt—  UO^^UU.HUUJ2.2. 

*— 02  2000— u.  0033 

233 

2 2 2 

LU 

3 

UJ  3 '—3 

IM  IM  >*r  U\ 

U 

3 w 

2 

X X X 

0 

21 

2:  i X 

O 

a 

a u 0 

(N 

300 

00  0 

BEST  AVAILABLE  COPY 


342 


OOUOOOOWOO^OOUOOUOOUOOUOOOOOOOUOUUOOUOOUOOOO 

—•  osj  r*  i o r*  co  lt»  o —*  in  m in  >o  r-  oo  u>  lj  eg  m >j-  in  vO  r-  oo  cjn  o — • <n  m >r  in  ^ r-  co  <-n  u ^ eg  m >r 
o » o k « i cn  rt  > o \ co  o \ >r  *r  *r  >r  ^ -r  >r  >$•  >r  'T  >r  u un  a \ u irn  mm  m m m >o  o >o  gj  gg  gg  o gj  >o  g^  r*  r-  r* 
ooooooounoonoooououooouoooouoooooonouoouoooo 


aUO^OUOOOOO<JUUUUOU<JUU(JUOOOUOUUUO<JOUUUUUOUOUO 


cc 

LU 

LU 

< 

h- 

2 

LU 

LJ 

oc 

LU 

CL 

X 

<1 

2- 


oO 

2 


<1 

a: 

•u 


o 

o 

in 


LJ 


2 

- 

»— « 

+ 

UJ 

LJ 

2 

LU 

rn 

*-LL 

LJ 

LL  LU 

□L 

2 

LUO 

LU 

u 

ou 

> 

►- 

CL  <N 

co 

LJ 

2 

>r 

II 

LJ 

LJ  LU  <\| 

♦ a 

+ 

LJ 

LJ»— 

I— 

u 

UJ 

< a 

1— 

I— 

ctO  O 

— ►— 

-50 

1- 

< 

LU2*—  • 

uuoo 

2^-»0 

oz^ 

ZwLL. 

h-2  a x 

X 2a. 

»-*  021-5 

X 2u_lu 

X — 5i/> 

-%  **vUr-^ 

< - LJ  210 

21  •LU 

21  O **ujO 

2:^20 

-*X  »N>f 

1—  2*^  • • 

• 2LJ  — 

LJ  4-  — 2Li- 

• *2  LJLJ 

•LL 

00‘MUJ 

•^—4  J-lJLP 

• — ‘ 22UJ 

Ci-U 

X 

2 — -i 

fNJ 

OX-(Z  o 

LJ  -3 

vAJXvuj<1  ZL 

• II  CL  • H II  II 

II  ♦ T>  l|  II  • 

^2:-'  • ii  lj 

||  -f-  -5  II  II  II 

II  LJ  II  — 

lU  **N  •*— *» 

r-  lj 

■*  LU 

L.r- 

-fl- 

LL 

-JvU— ’**  ^OOU“5t^^-5-* 

_JX<£OUJ(_n  ▼ 

2'-'H-  2^« 

• • • r-4  “JO 

1 • 

a.3L»-<LJ  • 

CJ  2^“5  -5LU 

• H 2 

*-*LU<t  II 

in  m— » x 

uznu 

O •OOtNJOr't  at 

►-►-i.  II  II 

2-*  ^.lL  —«u-  || 

^ H II  ^U-2 

II  II  II  2^ 

II  IN  N II  U.^U.  “Jh- 

IN  v\j— ; 

^^u.o. 

It  w II  wtu  uj 

OJ  — 

II  w m 

UJ  UJ'—’ 

II  II  -jr— l 

LJLi-LJUX2 

U.(J  UCU£.CUUU.^.X.^.  J 1 

Jiu^zuuuu-u 

LJ  LJ'-'UJ. 

LJ  -Cu_  a-  2 2 lj  *-<  o u»— • u lj  ^ u a.  2 lj  lj  *“•  a.  a.  2 lj  *-*  lj  lj  2 lj  *.  ^ lj  cj  gg  *-•  u)  lj  lj  lj  cj  u.  ul  »u 


LJ 

o 

OJ 


r*uj  y>u  ix^r'i 

—<<.N  l\J  VUINJIN 


BBf  AVAILABLE  COPY 

343  * 


, * 


oouoououoouoououooaoounououuoonouoououuouoouoouu 
^(\ioi>rA'ur'-aoc7'OxHNcn>rA'Or-uO(7'o*^c\jm>rut>ot^joa'o^r\ien>rA>L>r^co<j>o*-<r\jr,>>J'A*op*ao 
o o o o o o o ^ ^ ^ ^-4  rvj  rsj  i \j  c\j  rvj  i >j  rsj  eg  i ^ rg  m m m r 1 m rrj  n ) m m o ) >y  ^ >r  >r 'T 'T  >r  >r 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOUOOOOOOOQOOOO 

(xa»Q»Q_a-o.CLCLQ.u-a-u-a-Q.a.QLCLa.a.a.u.cLQ-a.Q.LLa-a.a.cLQ.ULQ.u.LLQ_u-Q-a_a.Q.Q.cLa-LLa-Q.a- 


dJ 

< 

CD 

LJ 

(X 


Hi 


<1 

CO 


2 

U 


u 

I 

.X. 


'JU 

— 

X 

f— 

X 

X 

< 

X 

xH 

1— 

X 

o 

UO 

X 

1-^ 

X 

II 

>- 

II 

-5 

-5 

X 

< 

x 

-** 

LL 

xx 

o 

h* 

“5 

XX 

LO 

CL 

XX  LJ 

Q_ 

X 

AO 

ul» 

x 

— »o 

O 

o' a 

X 

a 

O 

-X 

—X 

—x 

AO 

XX 

XX 

-X 

^ >H 

►— 

— O 

Q1' 

jC 

21 

X X 

-A  H 

X 

X 

X 

X X 

■— * 

X 

X 

X 

r-JsL 

oO 

— M 

X X 

-x 

X 

X 

X 

^sO 

A 

X 

X 

X 

OCT 

►— 

z 

-<>o 

m 

X 

X 

X 

M-lA 

o 

2l 

z 

r 

H(J> 

2 

X 

II  II 

o 

II 

II 

II 

II  II 

o 

II 

II 

II 

II  II 

MX 

OO 

o 

“5 

-5 

-5 

0-5 

rn 

O 

-5 

O 

-5-5 

a: 

It 

x x 

ro 

x 

X 

X 

x x._n 

X 

X 

X 

X X 

OL 

“5 

xx«^ 

x 

-x 

— 

-X 

^x*xm4 

-0 

-X, 

XX 

XX 

A XX 

x 

-5“5  CO 

o 

-5 

“5 

O 

0-9 

O 

o 

O 

z 

“5 

LLO-^LJ 

UJ 

CL 

LL 

LL 

»—  «— tw 

HU. 

LL 

CL 

LL  LL  _J 

•—• 

a— 

•> 

a 

X 

X 

X 

X X 

xx^CL 

X X 

X 

X 

•*  xt— 

a.*- 

►—  CL 

-)->t3 

— *vT 

x 

r*-o 

-5 

-5 

■no 

GC.  •*  x 

oo 

O 

-5 

0-5  UJ 

TO 

— ►c 

UJO 

irO 

-0 

X 

— QC^ 

2ar-.20-« 

^ * cn  <>■* 

x— 

x-^ 

**x 

-X 

^^«x<x 

—X  X-X 

lN4-x 

XX 

-X 

-L  dj 

^ N LJ 

x*  f\J  —in 

p» 

Lirrt 

hi 

PI 

ri'TOui 

A«NiU> 

-HUI 

A 

A 

cu^o  x 

*— » 

x rsj 

HI 

vT 

Ljejo  ** 

20  — 

*-«  CNJ 

m 

>T 

oauo 

ILJoO 

xoo 

ooooz^'-*— — « 

o 

~o 

o 

O 

OOOZZh-O 

— o 

o 

O 

OOO^H 

ZT 

r> 

ro  rrj 

• xrn 

m 

+ mrq 

m 

m 

• f-4  -n 

•f  Pio 

on 

O 

n,Mnrn 

— *s/1LJ  JU  • •* 

► - • »CJ  i 

1 LJ  •“ 

•» 

X 

X 

X 

X X • C_J 

| UJ  x 

X 

X 

X 

X X • X 

>—  — 

MX^UJ>0 

<}>OLl'4JO 

_n  | <; 

-o 

X.  1 vO 

NO 

o 

'L'DUJU 

U 1 vO 

X i o 

*0 

4J 

'OsOOh? 

jh^j  •ujqc.ujlu  • • x 21  ’-u uc. aj ex.  UluoiujqluJullulu  • xz^ci  ^ujuLOJaiujaiiJUJ  #ll» 

UL  Jh-»-XX  II  ll  -Jf— -J  It  *CI— —>l- ->t— -jr— h-*C  Il  ll  It  Ch-JkJh  Ji-f-CH- 

uj  jl  *— * r-  xx  *— * xx  wxxxxr^nx^-  '■^*— *r-  **<r“  •— xx*-«xx  wxx«— «»— 

^ A^u.a.ujaiij^u.a.ujaLujaiujaLLa.^Xu^u.u.ujAa.auja.ajaLua.a.ULa. 

* »K-  LJ  LJ ~ -»  U,  -*  JC  ^ a.  •-•< **  -*  OL  JC  u.  i.  ►-•  QL  -C  JL  -fc  C».  3.  -5  H-. ^ *.  m-> •—  _*  IX.  X.  — • -*  CL  _*  JL  .X  LL  Jt  X N-,  ^ 


3l 

u 


(\|  i»i  ^ in  -O  h UJ 


o *>4  "I 


344 


BEST  AVAILABLE  COPY 


UOOOOUOOOOOOOUOOUOU 

o'  o < >4  ct i r-  oo  cr  o *-*  cm  o > <•  u * 

>r  in  u \ m in  u un  in  u un  in  <;  >o  >o  >o  'O  *o  >o  o 
ooo  -)ounooo^oouoouou 

a.u-o_CLU»u.a.u.a.u.a.Q_u.a.a.u-Q_u.Q_ 


<w>o  <->cooot->oo*->oooooocx->ooooo<-j 
—4  cm  >r  m '0rs-coc7'0^f>grn  *rtn  >or^coa'0^f\jm>rLn'0 
cjo  OO  ooo^*-4*-4»-4»-4  «-4Cmim(\j<m  (M  c\j  cm 

OO  OOOOOOOOOOOOOOOOOOOOOOO 

<<x  <<K<<<<<<<<<<l<<<<<<l.<<a.<a.< 


UJ 

> 

•O  — • 

UJ 

• <J<J 

C\j  • «-w 

w 

— <cm'm 

l_l 

UJw^*-*  • • 

UJ 

►UJUJCMCMO 

►— 

• w *>.-4w-4  • 

iS) 

2 

• • UJUJCVJ 

CL 

P—4 

II  •*  •—« 

UJ 

CL 

If  II  • - LU 

JC 

Q. 

w 

</) 

II  II  - 

2 

UJ 

<1 

UL 

|| 

<1 

• W • — *— » 

—1 

» w ww  • *— * 

•a 

OO 

^(M  CM  •* 

UJ 

►-4v-4>-4  rncn  •. 

■ — ' cc 

O 

» •» 

LL  ^ 

-J 

WWW  •»  >M 

w 

<X 

<1  <1<1-  - ^ 

LUUJ 

:» 

www^c^w 

J-r— 

0.0.0.  ww< 

r-< 

0 

w W O.Q.  w 

f— 

0 

w W • O- 

\nn 

u»*y> 

CJ 

O 

W ww  W 

\VV.MSV 

f— • 

\— 

)<X— 4 W W 

2 •* 

r> 

<-<-xx-»— 

xxx— — 

»— 4*^ 

2 

•“  •*rr»>^xx 

'f'T^XXx 

CCO 

w 

oOCD 

-O  <J  •*  vf 

•*  •*  wNf'TNT 

0-4-4 

*— 4 

LX  — » 

• • >u  <J  w 

>0  ^ '■O  w *.  *. 

c_U 

•— « w 

CM  CM  • 

• • • >4J  “4J  sAJ 

f— 

U_  w 

•-<*-<  CM  CM  • •CJ'KCMCMCM  • * • 

2Uf 

uj 

!✓) 

UJUJ—*'-4CMCM  •<J»-4'-<r-4CM<MCM 

<f— 

2 

UJ  *— < 

► •‘UJUJ'^^CM  • 

UJ  LLJ  LU  r— « < 

c/> 

w 

-L 

w w w **UJ  LL;  •— 4(M 

•*  W WUJUULU 

00  2 

LU 

— OO 

• • w HU^ 

LU 

1 — 

UJ 

II  II  • - **111 

w w m 

f— 

< 

>0 

II  II  w w 

II  II  II 

< 

y- 

-J< 

II  II 

II  II  H 

—1  WWW 

co 

2H- 

II 

O— r-4 

►— * 

U»/l 

II 

•• 

JwlU 

—4 

>LL 

) 

« 

1 

1 

« 

« 

• 

<oujo. 

h-  • c\ji\jrgmroo 

2 oc in »—•*—« *”**-* •— *w  •»  <»-^*— <*— « 

uj  uj  »•>•>»•>»  *»rvj  r?)  w w w » w w 
CD  <3  • • • • • • •— • • • • • 

QC2:  •<<<<<<  •*  •»<<<<<< 

or^— ta.a.a.a.CLCL<*aQ_a.Q-a.CLa. 

>*  11.1  WWW  •*«—>  wwQ.  u.  wwwwww 

- Mm vT<\io >r 

Of-  * ► 4 w*ww*w*w  w^* 

-h  XXX^X'-XXXXXXXXXN 

wo-^wwwwwww—  — wwwwww 

t — >— ♦— t — » — H— f— ♦ — » — t — I — I — i — » — >— f— 

<O<K<C<<1<<<<1<<<<<< 

U.h-Lk(JLU.U.GL'-L.UUCLU.ll.a.ULU.uC.LZ.UL(-) 

o uuuuuuuuuuuuuuuu^: 

u_2u_u_u_u-u_u-u.u_u.u_u_u.u_u.u_u_uj 
«-j  *u  tm~< 

o uur)<juouH-"fi'',4,1Mni'r^ 

—*  ooooooooooooooo^ 

mmovmoirnrnmmmrnrnrnrnmm 


ohoz:  f—  ••  •* 

loo  •*  oou.3 

LU^  cm  Q-J  **Q. 

Z » »“Z  U.  HU(J 

•*  2m*-2 

**o<  - a. 

DO^ZOHhhD  X C 

OCC'O  •*♦—  2: OO «y^ U-  2:  — 4f— 

ua:^f-zz^^zu  — * -o  00 

<1  i;wV»  -v.  V.  'v  _J  Z •“  • 

ju.-j<ajuuiuu.O  11  + aio  **■ 

UJ  t/7  O CJ  cl 

2 22  jj-juoh  <a.f->ii  11  a.  11  11  + • 

— •o'JLJOcuaJijajaJcD  txjuzuiuo 

u\  1— * *-'-^2* 

DI^z^zzzzuj  m 11  11  *rn  in  mi ; 
Uh^^uUOuOQU  II  ~«w  — .w 

cc  0JuJ0.0_2Li_a_Jf.ujf'-  ja  ||  11  -^u_  11  imu.  h i 

oj  lu  uj 

-J  • L-;*—*  LUC-J  UJOJ  2 0 O'--’ ^2X^-1  LU  2 LJC-J*— 

vii-uuuuuuuUM^^^"J*itjua.uua., 
2 

uj  >^u  — • 

2.  — m m 


BES1  AVAILABLE  COPY 


UOOUOOUOOOOOOOUOOUOUUOUOOUOUUOOOOUOOUOOUOUOOUnOU 

ao  O'  o — « <nj  c* > 'T  ux  >o  Is-  ao  CT'  o — • cm  m «*■  in  so  r-  go  CT'  o -h  cm  m ir\  qd  O'  o *-«  <\j  m *r  in  r-  ao  O'  o *-*  «xj  m >r 

cm oj cm o ) m m o i m rn n > m m m ^ 'T 'T >r  -r  >r  «r u ■» *n u un m u > irun mm  >o o ^ »u o o no  >u  -u p*- r» 

UOOOOOOOOOOOOOUOOUOOOCOOOOOOOOUOOOOOOOOUOOOOO^OO 


— * 

—* 

4-  4* 

— J . 

— «• 

z 

-J  CM 

"3 

w 

— 2l 

f\J 

2TX 

4» 

w 

LL 

a.  — 

-J 

— — 

y 

LL 

UJ 

LLi  ll 

— 

LULL 

— 

UJ 

a 

O UJ 

LL 

LULL 

LL 

O 

p— J 

3Z*-*  O 

0 u 

UJ 

UU 

UJ 

U 

— CM 

u 

0 

uu 

O 

1 

+ Q.m  + 

4-  'M 

0 

u 

1 

rr\ 

4*  ♦ 

— ■ 

— 4*  LJ-* 

—»  -* 

+ 

-3  — 

p-J 

O f—cvi 

CM  O 

h- 

— ♦— » 2: 

-J  H-  — 

— OJ 

— * 

LL2: 

4-  O 

-XO  — 

w O X 

rz 

2:0.  -«  -3 

UJ  — 

j£ 

1- 

u>  cmo  — » 

— 0 

— — 

—a.  •— 

Oil 

•k 

-•  OX  2 — 

t/3—u.  UJO'J-JO  O LL  0 

LLQ 

LL  LL 

LL^  4*  LL 

ULUq. 

»~4 

*0 

i:—  UJ-"*U 

•0  •+  a.LU  • 

uj  in 

IL’LUQ. 

uj  #.  >r  uj  <f 

* 300 

1 O •*  -^p-J^-rz: 

•“-JU»— 3000  — 300 

LJ 

UUUU—*—  •* 

^ U»“  • 

II 

2^  iL  LL  •*  0 

^UJ 

1— fMh— O 

o + 

UUf- 

u ^ cmu  gmcMH 

00 

0— •—  2-  — 2C—  II  — < 

rO  00  U II 

II  II  II  OU“>  If 

“3 

u 1 *- 

II  II 

3 

fP|Q.  p-f  ^ V)  \ 

a 11  j 11  z 

02  M 

II  CM 

II  II 

11  11  11  -*  ♦ »i  + 

^ II 

*—* 

00  4*0  II  h-  ll  2—1“ 

■>—  •—*, 

— **r  — • 

OUJ  + 

»--*— 1 

LJ 

f—  c ►—  r— vi 

v^i—o— >—  »Mr-«tMp-H  j—  — rg  +-  — *2?3  — — ■» 

^ —-3'«*4 '31->ZZ 

ZT 

L') 

^ ox-ixx-i-hi  jmsj: 

ST 

zr^moj'J-rn-^  x x xz  inu 

-HZ  II  *-Z  i-  OUJ 

r\j2Z—  •— 

— — 

J II 

2. 

z <r 

ww  — 

O 

O'Z  ||  (NJZK  « 

II  P»  LL—»IL 

O.  UL  LL  ►—  —»  U-  LL 

LL 

f—  LL  U. 

LL  P ILL  II  rr)  II  U.  LL  II  LL  11 

CM 

If  It  O H ||  — p-4  «X 

II  UJ«»#IUUJLUUJ_J—  If  LU  UJ 

•1  UJ(\J4LLUUJ  II  uj  m UJ  If 

UJLU  LU 

U.  it  h-  II  r—r— 

VIU  uv^UUUVJUu.  UU 

UWUUU 

iUXUUiUAU 

•■“VU^XU  V)LJ  VJV) 

^U4.U^UUUU^^4.UU4.U^UL;UAUU2.UU^2.U^UUA.UIU2.2.^2.).U  JX.  LJ*.-^ac. 

IM  nT 

"I  rn 


CXI 
fl  t 


BtSl  AVAILABLE  COPV 


ounuuoouoonouoouoouoooounouoouoonouoouooooooouoo 
in  'V  r*«  oo  o <\i  rn  >r  in  vO  to  cr*  o *-*  c\j  m >r  m %o  ay  cr»  o »-« (\i  rr>  m ^ i^»  oo  u*  o eg  m -r  m >o  ^ co  & o ^ cm 
r-r-r^-r-  t^cd  cx3'-uooajauaoujcoco  v/'U'U^U'O' a>u>(j*u,*u>ooooc-?oc-joo<j— 

OUOOU^OUOOOOOOOOOOOOOOQOOh^^^^hhhhhm^hhh^^h^hhh 


uO 


CL 


-3 

1/5 

1 

w 

2 

X 

X 

X 

>T 

c 

♦ 

CO 

— « CO 

c/3  CO  O 

a 

X 

in 

X 

OX  2 

2-* 

O — 

CO 

CO 

x 

-H 

CO 

— CO  — x 

X + 

m i— 

nT 

2 

u 

— • 4 </3 

♦ 

— 1 4 

4 

O 

4 

0 + ^ *■ 

4 1—  — 

p— 

h- 

H-  X 

X 

O 

c 

c — 

— * 

— * 

— h-  ^ 

— C -3 

►— 

h~  XX 

-5 

1—  0 

0 

O 

-5 

C~3<xn 

-no  x ^ 

CM 

2 

<UJ 

w 

w 

w 

O 

w 

O'— 1-^ 

— a x 

3: 

20 

•» 

— Coo  2 0 

X 

0 X 

X 

X 

XCOX 

x— x 

•> 

2:  0— — X 

UJ 

J500UJ 

LLJ 

— 

X 

— Ul»-*x 

LUKCNJOXO 

— J«— • * cj 

a. 

■—  J.I 

0 

2 LJ 

X 

O v ' 

LJ 

<—*LJ  x 

X— f •■oo 

JL 

w f—  II  — « 

**—  2 

UJC/I—  4 »—  || 

LJ 

— xx 

0 

•2 

O 

•X  4 LJ 

00  4 *-H>“ 

O l|  CO  \ 

00 

1-20  < 

•H 

XX 

O 

2 -3  II 

— « II 

I-  *“ 

— 1 4 

2 II 

-*<ia  •XK^r, 

II 

— 4 • 1 II 

14  -T 

i <r  11 

-iuj  11  >r  11 

— « 11  «oO  II 

p—  ■»  ai^vih 

ZJ 

>r 

X • X 

• NO 

r— 2 + — 

| _J 

-J  LJ'-*'* 

1 oOO 

CL  2:  4 OOvi.ji.^-,00  4. 

— 

4 ua 

■ ♦ 

cox  + 

— 

O-  

-4-  —O  -3  X 

—<OX 

2 

*—«*—•  • ^ 

—5 

•*/n 

0 

2X'W' 

“5 

X->  -3 

-3  • !»  -3-3 

“5  03  2 II  -*3lI—  M -?  II  O II  >r-3  oO  II  ||  — C'-CcO  «Qw-)*-uZ’,)'-“5U^-5-0-5-|y)  f- 

-H  —•  «4.  II  ^ II  II  X a.  — • II  LL  h"  U-.  r— ^ II  U-  t£.  LL  Xf—  U_*£H-  — < II  U. 

II  II  ►—  II  t—  f“  ||  /S  II  VI  II  •— -X.P— X II  UJ  II  w UJ  X II  ^ II  UJ  ||  — UJ  II  UJ  II  X'— O uj 

LJ  \/IO  I/JVI  V ; <1  ^.LJ  v l Li.  IX.  ^ 1/3  LJ  LJ  u.auUU  LJXX  X u_  l_J  cJLJ  UU.UUHU 

nx~3*iO*-’~'3C-3^.i_-3xQ  T-'I/I—  2X  To  "O^cOO  ,Ju“)VJ*-v>-J\J'7^U“5'JU)')U>-*^U">V-; 


'T 

O 


BEST  AVAILABLE  COPY 


347 


IFINS.L1.NC2I 


oouoooouoooooooooounouounouoo 
m in  vo  ao  o *-t  (\j  n i in  vu  ^ ao  (Jh  o *-•  fN  ^ 'T  co  vj' o 

C\J  C\J  1>4  rvj  CVJ  rg  <nj  o 1 n i rr)  n > CO  ^ r»  > CO  rn  rr>  >r  >T 'T  >r ’*T  >r  >T  >T  >r  >r  IT>  LO 

<i<i<r<i<<<K^<K<i<i<<i<x<<K<a.<*<<i.<<<i<i<i<i 


oooooouocjuoooooouunouoooouoounouooooooou 
eg  m >r  in  o r- ao  o' o ^ c\i  rn  "T  u > vu  qo  ct' o ^ rvj  rr>  to 'O  co  o cm  ro  m od  o' c? 
o o O f J o o o o o ^ ^ -h  c\j  i n cnj  osi  nj  nj  i >j  rg  rg  csj  m n ^ m rn  m m crj  cn  co  >r 

onounooouooooooouuoooooooonouoouocooo too 

izi2:riizi:zizjzziizsiziisx2:2:xi2:zri.zzi2:zi.2: 


CJ 

2 

LU 

Q. 

Q. 

< 


•» 

»UJ 

eg 

U.I- 

UJ<1 

•o. 

□ H 

ll 

IJIO 

-J 

•— » 

< 

LL 

•» 

LJU- 

— * 

O 

o 

2 

— — 

*^4 

LL  LL 

^■4 

o - 

— 'LJ 

LL  LL 

OCNJ 

CO  *— ' 

22 

II 

OW 

200 

•»  *■ 

rr>LU 

IUZ 

—4  u 

03 

— *l— 

ZUJ 

ll  it 

O II 

U.^4. 

-•z 

-n 

^cr 

2 

oia 

LJ  — 

r»  «• 

O.J 

< 

o - 

LJ 

— — * 

M LL< 

CL 

O — 

II 

-5*3 

»-4aj 

H 

CJ 

•*vO  LJ 

It 

9-  9 

1 — Q- 

O 

— *“4  h— 

U» 

—KM 

en—  •— < 

II 

CL 

LUCO 

h-LU 

CL 

OUJ  2 

OC2 

<X< 

l/)</^h 

Q. 

OH—  •* 

CJ  CJ 

LL  LL 

— CL  LU 

CO 

<^i<I  — i 

X 

cso 

-JO 

•V*—c/)(y) 

CL 

CJ 

UJ 

2LJ 

\ UJ 

i^) 

xco  h- 

LJ 

2 

'Ul-  •— »oo 

LL 

U- 

OJ  ^ V) 

2 

•» 

••  •» 

— UJt— 2 

•—4 

CJ 

U •*  2 

CL  •* 

— 

2- 

•* 

< 

oo 

- -J*-4 

■— 

O 

•-•CO  — UJ 

2 

LL  LL. 

0-0- 

qC  j0>— *h- 

CL 

2 

^Oh 

O 

u-j 

JU 

ujql  cue 

UJ 

►— * 

— ^o<i 

LJ 

o. 

► •» 

uo<iO 

Q. 

►— 

OUJOh 

2 

—t 

2IH-CCO 

O 

CO 

0*“^lO 

•*X 

OLL 

II  ll 

DUCUJ 

2 

*— • 

0<w^- 

IL2. 

-«a 

•— « •— • 

2LUQC 

• 

-Hh—  CJ  *• 

LU  •* 

cD 

•*  •» 

J>CLUJ 

H- 

^CO>—  ^UJ 

22 

— — 

2.  O 

O 

2-"3i/>lli- 

uz 

LUO 

00<N 

LULUUJ2 

• 

O ***2<1 

»■  ►<! 

2-« 

CCU12 

_|KH<I 

CL 

O—  •*  **H- 

aju. 

— *LO 

CJL.J  ► 

-4  C\1 

CO  <L  < — J 

LL 

2C0  — rgCOQ.  ^Q.  _J 

t-)2 

a:t--4 

LJt— f—  <1 

2 

•*»-<o^"Ja.iuu<i 

IUOJ 

LL  UJ  2 

UJ  UJ 

ex.  xc/j  v;uj 

— » • 

— — * — — 

z>-z  - 

ii  xcj 

Zi  •* 

t— H- 

•JJU. 

H-QC 

oixiw_((- 

-<  *'U 

►-•ac 

*•<0. 

« 

LU  UJ  LU 

oClj 

Ol— <zo 

HQQ. 

cl 

clol 

— ►Ill 

C • 

CKO  -t-r^a«i 

O 2 

ww  — 

XhHh 

COLO 

— il—  I— 22 

ZKOX  c 

20 

il  a- 

— 1 >0 

— o 

<X 

2~ 

— *■—  • 

C->  — 

h-lJ 

r-i^z<amjiuu.u->  o 

1—0  CN 

extern  — 

♦ ooo 

MO  --CZ2 

w-3 

iu—oin 

OZO-4mmmuOOOHU 

2 2 2 -j  -J  -J  -J -J  -JOO 

'/UlJCl/M-  OmCLOOu. 

>r  xjcqccx. 

Z3Z 

uaua’accoju^  o ••  n 

||  ••  W/>-4»— • 

*-<LJ  — 0)0.  ^4  — cu  It 

ll  + ►•Haa.a  it 

it  II  II  • 

*— * *— < •— « 'v.  >v 

VSNNii  ^ 

1 •— - 

<4. 

2 *• 

'•O'—' 

XI- 

oo</>uo.*;rr  zzz^iuj  u-</i 

1 H uif-  iiuiri- 

irun  t—  uj  ll  r-*  — ■ i—  o C o i— 

CO  0.00 

^ZZCOCUU^O  ll  UJCDOC  1 

1 s^v»<l-  'JJ. 

21L<*— ►— 1— 

<ULJ*—  # 

UJUjaJ2.ZLZ12.UJ  LJLJLU  1 (iUJLH 

Ul 

UUA<1U 

t-3E 

I-<ICJLX- 12 

4.i.iJ.Z4.iXLf-au-7a  | LU  *4.  LX. 

<4  LL  LL  f—  CJ 

II  — LL 

VJOJU.l/»J^ 

•-•►-•  •"* CJCJCJCJCJCJdLCJCJcjCJ  ••  CL^-LJC; 

• • uJUU.UJvwuv/fsj 

CLLJ  •• 

Q- LL  LL  uL  <4.  U. 

CJ  CJ  «u  LJ  LJ  LJ  o O LJ  2 2 2 2 1— o U- LL  LJ  >— QC.  LLLJ  ULCX.  U- 2 2 2 -*  U- 

zz 

2 

UJ 

I'M 

uj  (M 

CJ 

OLU 

2 

LJ 

2 td 

CJ 

oa. 

2. 

O 

2 O 

CJ 

Ol 

«J 

^4 

LJ  — 1 

—4 

■fu 

OO 

LJ 

OLJO 

349 


BEST  AVAILABLE  COW 


ououuouuoooounououuoonouQuuouuooooooououuoouoooo 
^ 04  tr' u > >o  go  o' o ^ eg  n i ^ u ^ r- ao  cr  o <\i  m >rir\  oo  cj' o -4  <\i  m ltn  vO  co  o ^ cm  rn  >r  ir\ 'O  cd 

"T  >r>r>r  vmnuMnu  tuHnu-Mn>Dvu 'U'OOO'U 'L>vO'Or*-r^  rT»p»p-r-r»f*-r*- go  go  coco  go  coco  coao 

ouoouoooooooonouoooooooooouooooooooooooooooooono 


GO 

CD 

LJ 


CJ 


Z 

X 


o 

»— 


z 

o 


< 

O 


LU 

o 

< 


O<-0 

a.*-* 

o w 


CO 

AJOJ 

o 

< 

UJ 

uj<j. 

1— 1— 

LJ 

H- 

<T  GO 

I— 

y) 

CL  Z 

at: 

n- 

u 

*— • 

AJ-* 

LJ 

UJ 

X 

zo 

GO 

o 

— * 

< 

cc 

+ o 

co  a: 

CO 

X 

3 

(M  — 

CJ  LU 

O 

X 

X 

^(M 

#*vU 

— < X 

zz 

DOM 

a 

z 

X 

cr  •.  •» 

O'  x^u> 

o ^ 

o 

o 

X 

ojljlj  tn 

-'CM 

H" 

H* 

•— « 

1— 

— c\j 

— "*  ►!—  •* 

*—• 

♦ 

h- 

X' 

□ UCJ 

pg  '-'LJ  -*wx 

w 

O 

LJ 

<a 

X 

y—zz  o 

Ujh-h  — aui 

X 

LJ  GO 

-^LJ 

rvl^ 

> 

h* 

-4  0 1-0  X"2  •* 

1— 

13 

h- 

*~*X 

coo 

Z t-  <Gh  h-  O 

< 

— C 

X — 

- JZ 

ajoijzz  x a 

X ZhCZ  < — — 

Zh 

QQ.O 

oo 

<X  •» 

>— 1-» 

— c -<z  o 

1 21  O Z **g0  •*  OC— « •* 

•*G0 

•CL  O 

CD  • 

CJ 

•*^0  ••CM— 4^-*«^*— O # •- 

*—zz 

<Xh- 

1— 

h-«£ 

i“  • • « CM  X.  — ■ 

-»zC  XX  hu«l 

L J ih^mU 

— • II 

1 GO 

— II  | i II  — 1 — 

ZZ  II  ——•2.  II  II  II  »-Z  ii  II  ZllJ* 

II  II 

W • 

1 

Z 

Z 1-  - » - 

H-  LJ  1 

4-l-h- 

aioo  ii  — + + oil  — •++n—  • + ii  — •-<— o ii  — — r— x 

X4.  • 

— 0 C 

z 

Z-1Z. 

• XX.  *— « *— • •— MJJ 

*-•  •— • • »— ir-»  it  <Z<M. 

f-4  •— < 

C 

c ii  a 

•—* 

o<<t>—— — i— iqi-i- oxx—'—oxi—^r^— o»-i»»w  t-wi 

lhcd  — 

CE  H O 

»— .(UOO 

II  Z>  »» 

"II  UJJZ^-ZZ  UJ  •■*-•*-  UJ  • i UJCNUJI—  UJUJt—  c/1»— 

(MX 

< 1-  II 

||  <G 

II  X..JJO 

CO 

LJ  rvj|—  col—  -4 

•TV-X  vC»— Ol— CJCOI— h-<X<U_J^-4|— 

T-2!  — J»— • »»  II  LJ  JZH  II  l\J«Z  II  ||  II  II  CM <±'Z  II  II  iNJ<iaL  ||  ^:cm<1<  *—t<i 

O'-*— Z •—,  u.^  f—  r— ^ r— r-  rr^^u.  h- 

itru,j.u,<lii^‘'i^M  ••UL)  ••  LJU-  — «iNv_JG')^x^*>JLJ'/MJ-^.>CLJv/;u-4C.V-J'/M«Jv;a-v-js/>ty)*-^u-LJLJCJV) 
Z *■*  Z Z LJ *-•  -* X *-  3*.  >—  LJ  ^ ►-  ^ ~ X ^ LJ  •—  X A.  a.  X — i *- 2-  LJ *“•  — « 2-  LJ »-« t_  it >—  LJ  “5 —• LJ  •"*  X LJ LJ  *-• 
Z 


z 

oj 

2_ 


<M 

AJ 


"I 

tNJ 


'TUI 

l>4»>4 


2- 

a 

LJ 


t>*«>JfM 

CJ 


GO  O GOGO 

•M  O VXI>4 

O CJ*H 


BEST  AVAILABLE  COPY 


350 


uouooonoooouoooooooooouoouoouoooouoouoouoouoonoo 
u' o — « <\j  m >rin  o ao  cjn  cj  ^ rg  r«  i nj*  in  cjo  o cm  rn  >r  \r\  ao  cp  o osi  m >r  ^ ao  vj>  o -4  rg  m vn  vO 

oLKj'y>u>u>i/'UNU'U'i/'(/Noooc^oooooo*-H»-«^^^r-4^^*-^^r\jf\ji\jcNj(\jf>JOsjc\jcMrornmmrommm 

OOUOOOOOOOOHHH 

liri-ziiiiiziiizxixziixiii 


X 

o 


LU 

V) 


a 


<i 

o 

CJ 


2 

— * 

UJ 

<1 

1— 

O 

UJ 

2 

r— 

LJ 

LJ 

2 

2 

*— • 

•k 

— 

4— 

CM 

— 1 

<a 

II 

_J 

<1 

O 

aj 

3 

► 

+ 

UJ 

— 

r- 

^>4 

2 

UJ 

W 

— i 

LU 

l-/ 

IU 

UL 

2 

J— 

\ 

QL 

— • — 

< 

<. 

— 

X 

CM  CM 

r— 

— k 

LJ 

-JO 

ex 

< 

on 

3 

a 

XI 

*— 4 

a — 

X 

+ + 

4— 

O 2 

O 

o 

4- 

•» 

- 1 

—4 

ai 

2 

UJ 

rg  •— • 

<S) 

OO 

> 

UJ 

4- 

-»-*  •» 

X 

<— 1»^ 

QL 

<L 

Uj  — k 

X 

UJ 

CL 

4- 

1—  X 

— 

4— 

X) 

m 

<1  <1. 

QL 

— *>r 

OO 

o 

2 

QL  3. 

LJ 

CMO 

ax 

H- 

"4 

■fr  «— 

X 

oo 

on 

. f_ 

— 

CM  UJ 

o »• 

•k  •> 

a 

a 

+ 

O 4- 

X 

rn^LJ 

—4  CM 

4- 

o 

<1 

X' 

Jh 

2 

00 

o 

+ h- 

4- 

O - 

xx 

UJ 

X 

CM 

—1 

OQ 

o 

4-— O 

4—  4- 

QC 

-ion 

*k 

•-*  »— » 

Ui 

xu> 

<X-^ 

OL 

X 

vO 

II 

XJ  — • w 

> 

OX 

QC  QL 

O 

oca 

w 

-o 

CL  —4  UJ 

oo— 

* * 

O 

o 

UJ 

— * 

O *f  4“ 

IU 

O OO 

—4  C\| 

XOL 

4- 

—1 

» ►— « <1 

4- 

in^  — • 

oo 

QL 

LJ 

*— t 

o 

w m ql 

<.4- 

—4X23 

LJ  *— 

UU  LL. 

OL 

4- 

w lil  1-  H 

1-0 

LJ  | X^X 

II  II 

X — 4 O 

4- 

3 

LU  K-  LU  LJ  + 

oni— 

4-  + ax  • 

H-  2 

<QL 

3 

• 

I—  <t  CL  1—  Q 

2^ 

2 ox  — 

Q^  QL 

i/>->+  z 31 

xo 

— 

O 

3 

< — - <t->Z  *-  (- 

i—  •.ooooxaax 

XX 

4- 

Z'U  r-iOC  lUZS)t~  - < 

XHJOZUJZZUJ 

— — » 

QLC5X  X 

liJ  LJ 

• 

* • 

-j*  4-^H-i^^4-*-)a-5ci: 

LUQ.W 

o o 

—‘CM 

xuaa  2. 

4-UJLJO 

02  — 

» LL»—  3 > 

4L20U 

— u OJ4— — X* 

• • 

-*•-•2X2  II  * 

<1  -> 

•UJ 

• 2*“* 

1 — i -U-Jh- ^ II  II  II  + *-1 

4- LJ  Nt^aN 

03 

uj  2*-*2  o 2 

-1 

o • 

UJ 

w 

W 00  LU  — O 

X ||  <1 

•—2  «X)2 

XX 

2’— 2 * W hX^I 

3UJ 

0-* 

_i  ii  uj  z?  r i — ii  — — * ii  4— —ox 

4-  4— 

xoo  X 2W 

• • 

O * 

or—  ||  < 

• 

1— 

U.  II  <l»-^  !•  UJ 

**UQV>-J_j  II  ILUX 

XX 

4—  f — II  UMXN^  1 

0< 

4— 

3*-*<IO  a^C4  11  DOUJJM 

• w OX’^JOXX 

X00  ~-4  J.IU 

— 4<»— 

4-onooa. 

1- 

^.t—  ^.z  UJOJ  »—  Z 

QL 

3.UJILOJQ 

•» 

</)XX  3 4-2. 

O00<X 

LJCMOO 

< n Lu-J-h-i— m>— t—  • n <•-• 

II  OO  II  04-XIM  201-4- 

u ii  m it  ii  <i 

II 

or  — ii 

II  2i 

•I** 

II  Qt.  II  111X00^^01  <A  —>  CL*~ 

a\ 

-SL<LJ^.-J»-* 

22 

II  2 4-  M 

->  x*  ^ 4— r-  Iih-^x^cx  2- 

«— 4-WW^jw 

II  '-*w 

••  «AUA^VJ 

4-  a.  it  a.  uj  a.  a.  — a. 
2 

XOT*  oj 

A.INJ  *'  I 

2. 

o 

O 


»— U-  — » V4U-LJU-  ivi»— • LJ0Ol/>LJ  JU-V)INU.<IU.  VA-U- 

LJ  — O -J  •-•  LJ  •"•  O LJ  2.  A.  A-  2 o U 3 ”> *-•  2.  Cj  O -a- C-J  2.  *-i  “>  2 >-4  0 I-I QL  >-•  »-t 


l'l 


m 


o 

uu 


2- 

2L 

LJ 

o 


351 


BEST  AVAILABLE  COPY 


OUOOUOOU^OUOOUOOOOUOOCJOOOOOOOUOQUOUOgUOOOOOUOOUO 

co  o'  o c\j  m >r  m so  ao  (j*  o »-•  c\j  m >r  in  >o  r-  go  lt  o —4  eg  m >r  in  >o  r-  oo  ij*  o —4  cm  cc\  >r  in  nu  r-  co  cp  o •-«  cm  rn  m 
m m >r  'T  >r  >r  ^ >r  >r  ^ u ' in  u^urun  irux  > u ^ u > >o  ^ 'O  O 'O  ^ r- r- r- p- a3  ao  co  aj  oo  co 

tr— 4— 4i-4i-*,  <>-*.  I,  |,  J.  i»—4*.4,  4 — 4 — J ^ —4  — < »■<  ^-4  — 4 — 4 —4 


< 

LL 

a: 

OX 

h— 

> 

M 

<3. 

►-i 

oo  o: 

(X 

O 

xi- 

> 

N 

CL<1 

*-4 

OL 

2. 

UJ 

«* 

“3 

£X 

^>TN 

— » 

U2 

t\JO— 

z: 

II 

LXO 

-l-*2 

i 

*— * 

^ •*  I 

oO 

CL 

lih 

in— looo 

_J 

LU 

Q»-4 

-IH-J 

•» 

UJ 

H-iO 

o • 

Hi 

* 

uz 

l-^OLU 

Q. 

—) 

OJC 

a.uao 

> 

— * 

>oc 

LJLU  >>o^h 

h— 

— 

r— 

vO 

* 

— * — 

i—4  —111 

LU 

0020 

UJ 

UJ 

O 

w 

“3  * 

m no. 

H-O 

^*fS4  •'^♦—  O 

Q. 

LL 

1^- 

< 

*•  — 

<3.  UJ 

— j 

LL^fOLU  H- 

I-U^- 

> 

UJ 

a. 

UJ  ox 

—«  X UJt— 

P—  •—* 

LU-'Ujr— o 

U.I— 

h— 

Q.U 

-J 

h-  H-  < LU 

in  <toj  »— -> 

LOli. 

rJ 

♦ 

LJX  *<JOU 

>-^ 

””3 

>-►- 

< 

x<r  n 

• ia  < • 

►— « 

->r 

olu  *— a:  o 

b— 

2 

H-  CD 

z<i-aaw> 

hQl  X OOO 

LL 

Oqil  — 

-3  M 

II  3 

2^0  3 

ii  ZDS'/’Z'Jcut- 

r-  tuh-  •j/>uj 

XU1  -JZ 

LU 

22TLLJ  II  n-^ 

21 

3 0 2 

2 

»— ^x*-*  • 

Uj5T^UJ»-4  — 

u 

•— »o  »o 

U‘  II  — 

— * 

II  •» 

OJ  ||  — »<a 

— <i  <i  — 

•CL  LU  II 

O 

LL  U. 

LL  II 

— f-4  0J 

a-  + o » ZK  ii 

*-<  + i-  1 a.  ii  -3 

I t— 

vj 

OQ-^JLL'JJL-# 

UJ 

LU 

1 — O 3 

LU  «♦ 

— *i/3 

l/>  w 

IJJ»— 4 

1-  < — -t-2 

OZ'XI  ILUOK  XLU 

UJ  — 

X • ♦ 

Q *■ 

II  ^ClM-^ 

1 x o*—cn  ii  — oj 

1 — 

KX^'-UO  • 

-3<l^ 

^1/>XX<UJ  II 

ox«a 

T-JUJ  ZUl  <5,  “3»—  UJ<4-J 

L_K/)_i  II 

li 

UXUAUXX  II 

2l  “7  m -3  -i  <1  *«3. 2>  -J  X 

v*<  jl  ->w^ 

OOX  II  II  II  **3w<I  jlu_j- 

-4  ||  L->-«  — 

H'JUiUNUiu 

II  ^ 

m^w 

2T2.W  #<3-3 

2*. 

ujujx  iiZa  uu>— 

^ ujOilZUJLJ^qiuo 

LULU 

lulu 

UJX2. 

— ii 

vOI—t—  <XLU»“ 

-*0  tl  i- UJUJCMf-^' 

-•'OU-OUJ  III—  XUJ 

'Vi  2^Z5U 

LLII—I— 

OHt- 

II  II  3 im 

u.  ii  'T<i<i.a.<ih-^  LUU.U. m «*.•-«»—  r'-CL  u <1.00  n i >-4  ll —4 <*►-•«*,<  <^.  n >o 

UJ  a r— r-^-^r- ^.-^xuli^^  ^ ih-uu  — * -J— 'Ui'-”— 'lj r—  r-ujx*— ^ 

l_jcu<H_J''A'>ALL.r— c/Ia_ju_  <lJCr“r— uw>u»i_j  ••  <Ja.i  ia.ii./T‘i/)v<i  Jv;i/)nc>ynj-im  i 

U^2.U  >*-*3L  “30  •-•.*.  J3L“3uJ“3*-4  0*—  CJ  2.—*^  “3*“«2  ~3“30  -3  “3  2.  *.  “3 -*  _l  O 

<: 

>4J  >4J  fNJLU  «'  • >3"  O *— • 

•M  T U>  *'2.  Ui  m >0"U 

5: 

CD 

CJ<_) 


BEST  AVAILABLE  COPY 


352 


uouoouoouooooouooooooououuoonooooooooouoououuooo 
oo  cr  o •— < > rg  m >r  u > ao  (7s  o — < rg  m >J*  u > g?  Is-  co  O'  o ^ rg  m >$•  m >u  r*-  ao  u*  o •-*  rg  n ) >r  ‘.n  gj  r*  co  O'  o ^ rg  cn 
co  go  co  ao  vr  v/*  O'  in  m vn  <n  <j>  <n  vj  o O o O O O O o O — < »-*  •■*  — < —«  —•  rg  cni  eg  c\j  rg  c\j  c\j  rg  c\j  rg  m m m 

^^^^^^^^^^^^^^cgrgrsjrgpgrgrgcgrgrgrgrgrgtgrgcgrgcgrgrgrgogrgrgrgrgrgixirgrgrgrgrgrg 

rJxxzzizaLZX^iixi2:z5:ia.KiZ2:2:za.zzi.ij:ia:2:zzxiri2:3:3:zr 


••it 

x 

Ol\J 


mx 

r-*xs 


►-m 

<Xt-* 

— 

— *LLJ- 

I— I— 
C<1  M 


—4 

L- h- 

Zo0-^ 

II 

• 

— ^ 

II  UJ  *• 

LL  — • 

oux 

UJ  X. 

••zm 

u o> 

-%<i 

O a. 

oim 

— « ^g  ^ 

wO—« 

z 

UJ  - 

+ •»  — 

i-o- 

x a.  z 

<1.1— 

— i.  LJ  u 

1—  II 

iiz1-* 

1/>I- 

*—  • r- 

o 

— «U — 1 

, <i 

au 

^-a._i 

— — o o 

-UJ- 

OJ  • Qf 

o 

r\JH-  - 

|—  — ^OJ  UJ 

h- 

ZKX 

< x -»- 

9 ^ 

-<im 

i—  — iu  — . <r  aj 

coo  in 

— 

z 

co  - QCLi—  o 

o r* 

3EZrn 

u 

Z z oo  z 

O 

rc|  *— « 

— Ot—m  ^ < 

h-~  o 

-J  - 

r-  rgi— 

Z - - • O-J 

— J 1— 

Ji- 

-J  ^3^ 

r^<i 

u ii  —oa  o< 

a-< 

-UJ 

-j  r» 

1 

OLL  13 

O *-*  *0  — «cn 

o • o 

CL  o II 

> — i + 

”3 

f-iiiau 

Zuj-  — rg  • 

O r-  O 

— <aj 

*“ < ^ »-h 

or— uj 

h—  **a_  f-^u.  -iui- 

-^lu  r- 

-UCL 

i.  m — ^o 

OJ 

OO 

ii  <i nTujujuj  r—  x 

»— * • —• 

ucr*H 

1 oz— ' 

►— 

OtsiCUJ 

o •a-f  iuo*-«  • •-«  o — * 

— |Q_- 

o h-  a 

<T 

ZOO 

XOO  -O-  O 02 

•— • UJ  • h-  • 

Q-  - 

Z +2  Z 

H 

— z 

12-  w «UJO 

a -f  zq  c? 

Z -X 

- C 

oo 

O II  — < 

CL  + ZH  aC 

z •zcsjo  z'jj 

xm 

JX  -•  O O*— •— i ■♦• 

*— * 

t — J 

— - — - •<— • c 

•— o » ••— * 

— o - 

JZ  O 5.  org 

I— — «d. 

0~«  *KM  •l-l— UU.-J  CL  • II  Z — 

nT  i 

| - II  xx—  — * 

ii 

otuujaj 

•CXOXOoO  • 

— j I — *rg  ^ Z "O  ll 

O'X'-'  — 

-l-ii.  — < 1 II  II 

• »-Z 

ujooom  •zoo. 

►'O 

w — o z 

— 

u-d  •»— 

2T<\j*-ic\jwu_  UJO  II  OUJ  • Q_  — i | + if  OJ  — 

inv-  huo  ii  -f  oo  i • i »o“3—  » 

*— «jz 

• *N  -U  E 4JU  II  • 

^ LU  •—  • I—  “3^4UJ  ••'V  UUZ  ►—  !J  LLi  •— » *3 

w 

3^co<-h 

oi— >u<j — uj_,<\i-j< — 

^ 0<J^  ll  rgrg 

I*-4  “3  CL  X UJ -4 rvj  CJ  co  — x ^ 

uj.Z'/izajtt  — 1 

I *- •' «—  >—  f—  o OL)  •— • UJ 

2(—  »uj^*.X  ►-uj 

Zwr-  - 

i muji  *5Ii.  *zr^uj^-Z 

i—  ^u.wq.q.  auj<Lij<rg»—  ato^  ooegf—  • in^Ku*-«aj<oxu  co  ►—  x — « oh 

dh-’-'Z*-'  II  uu  II  *—  a.<x*-«  ll  II  i^*-<li-r-i-i^u^r-  II  r-  II  <4  II  II  ii  A_  n -*<  il  ii 

r-^.^V-iw  '— •— •uL'-^UL'—r-'—  ^^olijv  i—  w v r— 

v/uu.(j^>  ••JsuuutLJui.j.ju.om.  ••L;u.u.u.v>u.^'Mua.(/njuu.u^',iuXuv)i/»Aa.'Hl\ju.-JU'/; 


->O^Z 

-*U.  Jt 

IL^Z 

— Lja_LJ 

z 

z 

IMOH 

UJ 

rgcgm 

UJ 

ni'ii'T  r» 

UJ 

UJ 

gjr^r- 

z 

o 

a. 

r-r-LJ  r» 

r» 

r- 

a. 

o 

o 

a. 

O 

O 

o 

rg 

'N 

u 

in 

o 

o 

BEST  AVAILABLE  COPY 


353 


oouooQoonounouoouooooonououoouoououuoonouoouoouo 
>r  'U  r-  go  <j\  o — ♦ <M  ro  >r  in  vO  co  ex'  w —•  cm  m u ' o r^»  cu  in  o r-i  cm  n > >j*  in  hj  x uj  lp  o —« cm  cn  in  h*  co  cp  o *-i 
r*  ■»  rn  cn  m o cn  >r  >r  >r  >r  >r  >r  *r  >r  u > in  u > m in  u i m m u un  >u  >0  *o  o >0  >u  >u  o >0  o x x r-  x n»  r-  r-  r»  x ao  00 
cm  cm  cm  cm  rg  c\j  cm  cm  c\i  cm  c m cm  (Nj  1 m cm  cm  cm  eg  cm  (\j  cm  rsj  eg  eg  eg  <\j  in  cm  cm  c \J  <\i  cm  cm  cm  cm  cm  <\j  cm  cm  cm  cm  cm  cm  cm  <N  cm  cm  cm 

i.j.iziriiiiziiiizzzj;izxiizxziiizixzizj.iiziixzxizi 


0 

• 

••V*  ►CT*  ™5  •» 

C^oo 

XCM  x*— ' - 

XLUCJ 

ao-*  0 

— H-«LU 

•»  •>  LL. 

C/JULUJ 

— <M»  X •*  UJU 

21—0 

0*—  ®CJ'COQ.- 

— * 

Q2X 

U.  •*</!  —-•—•>•  •“ 

2 

C/)  LU  LU 

LJ-  ► h-X 

2 

<1 

U)»  X-  0 

— 

UJ  LJ  LO 

(M— IA/)Z  — • •*— * 

CM 

01  LX  CD 

— (UM«/1CtX\ 

—* 

OJC 

UJ  u 1 LJ  CL  — • *—  O'  • 

oxo 

•— 1 — 5<Z  <L-*C/) 

VL. 

22 

W 

— «ULL 

IXCXCMC/IUJ  • o 

<1 

JE2W 

•*uj  i— 

— 

O 

X LL<  C£  <1 U LU 

— 

—ILL  CL 

DCldOH  — — <Nl 

2 

— JOLU 

♦— 

2 

O CD 

LJCXI— ^ — «—■ *uj 

— 

LLQ12. 

% 

►UJ  LU  LL.  'V ) _J  a. 

LUO 

— •uL.U-LJLU^-’^X 

*— 

UJtU2— * 

^ lj  0 

<1 

1Z-  rn 

lux  aiQLcro 

U. 

K-O  ►— « 

r-QaauJhiii  ► 

— J 

2X  ► 

< UJ  1 OX 

< 

UL  - O- 

x JCaOLOX’-Ua;  vO 

- 

O — l 

•uji.M3ia.  ► 

XXLO 

XXO  2»-  - 

2 

jcuuoino 

ujx^:z)  (juo 

2 

UJ2— *—LU 

00-  aJZZtu 

— 

lL  wx  -LU 

02  ►o<z-*^uj 

CM 

w u>-  LJ 

aj 

X f— 

— r 

2<X— * X 

CM 

2 **001— OC/JLJ  ^ 

LU 

►O  •K/IUJ 

O 

►X  ►<I-ILZ'-I* 

H-  — * 

a. 

lOUL*  Q 

— * 

LUCOCM-  • *-»<  | 

< — 

h- 

CL  LULO 

i—  ^^-4  ».  •.(xonu  1 

CC'U 

2 

QQcOUJ-J 

O 

<-  •■XXKCCQ.  1 

— • 

uc 

oiuaw< 

O' 

1— 

H-  •••  CO LT\ 2 • > 1 

— CM 

Q. 

p- 

iS><[  •—^UJ  *4—  I 

2'”* 

20LULUUJ 

O 

21—lO-  v.  x-  I 

2LU 

(Mao  —) 

►00  X 

w 

<0 

►<^ ►—*••—  LJMJ  ► | 

— — 

OCT'  -J 

LLOOXXCL 

h- 

(MQ  LUOOQL  — *X  | 

—*x 

-1-4  *4. 

LU  UJMM 

— w 

2 L02U-U-1  ►'O  I 

O 

00  012 

a 

— » 

► XCQ— 'O^Ni*  •*  1 

LU- 

au 

OOLOl— UJ 

-*  2 

— «LULJ  _JU_  200-  I 

»->r 

i—  t— 

O 2 u ! c a. 

m 

-n  2 -« 

2 —1”0Q_  LJUJC/J  | 

< ► 

2 HZ 

— aj  — aj» 

QC  — * 

uw 

►2<l  LL 

U CM 

a -«  1 

Q.O— 10— • <0  ►CL 

OO  LU 

0LUJI-2C 

1—  • 

i-  0 

CL  CC  to  LLQC-5XQ.2  ► 

Y— 

w_jonO 

a 

H-  LU 

za.aj«vio  iriz: 

2T- 

*4.^  < — 

2cD  — *2 

— * 02  UJ 

O </>  h- 

- q.q_j  aj<M»-  “ a. 

— *OUJf—  —♦ 

ClLh-Lil 

2 O - »fM 

0 2 < 

— ►>■  <5  qXO  C\j  f— 4 

— Q_  — 

• *H-O0  • 

— 20— 'X 

2 — 

• 0 

'TXr-UilU^UJ  ► 

U T — «— * 

WLU^^L  W 

>ua  '^2 

1 — 20  ll  — * 

— — • I—  U) 

OO  2UJC>CL^  !|  0 — * 

UJ2I—  ► UJ 

0-  220 

O — 

O _J  2 

^ 0 ^ LL »— X 2:  ac  >- 'U 

OX  — 1 — 

• *L0-4  _J  lj 

O -UJ<2 

O • It  1 

* ♦ • fO 

CU-Z  OCDOuJCMXlC.2* 

*-»  W 1— O 

wiu4j  'uxjj  '»  0 

»»  -X  UJf-nL  00-  kMrfl 

•»^4  ►x 

— 'OCX  II  UVIUUU'  ►U12U-  fcUJ 

a uj-)<«xuj_)^  j ju  j — < 

'O’— ’ocoor  • ►— 4 

X — 'O  — * 

200  u)(XO— ‘vO  — 0 X 0 

• h-Uli. 

•2  JZZZUJ 

H- ^1— LU  3UJ-J  ►XUJ^j 

-h'-h C02D  • II  (JL< 

— I—  ZiuOZ 

XO'U)!- 

x— a —•*-!—«  h-o  a:  uj<oo-  a.<.  x -0  llj  <3  uj  < a-  < — * a. 

Cuj<- 

II  II  ||  Zl-H  II  1— 

LJH-  i ► 1“  O ►X  — < 

»- 2: 1-2: 

‘ W— ' w 

►— h- 2 ►HXI-a 

z-il- 

UJ*— *ul._)XI— QCM-  U\ 

• UL»— ItX 

— — * II  — I— w 

— 2X  >T2WO 

<N  — ILL  OLLl/>Xu.LJLJ-JLJLLl— MJ>LJ<L  2W^in<^ *— XLO"-»VwCXLJliWU-LL  W*— <*.U_«4-LJ2LJ02— ,Wr”2 

2 — J— 'LJ— *— * JL. 

-*L)OJU«UZ^«JU.»  -*•  • XCDiNLJ JCU--*LL. 

— *WLJCL  W^ww  JELL  ^*— • ►UVIUJ 

—4  c\4  n t >j-  tn  r^ 

»-4fMO) 

CO 

L/'  L-»*-^  LJ 

>rn>>r 

— •U'Y  — • 

'M'U  W W 

r» 

r*  uuuj  lj 

woo 

wo  — • 

O W U'W 

-h 

-HC 

— *0  — 1 

HO  — 

— « 

CM 

fM  CM 

tM 

best  avaiiabu  copy 


ouoououuooooonauouuc'JooonouounouoouoouQuoouoQuiu 
xcm<t^u'\>o^-coo'0  — rgrn  >rir\  xr^covj'o— egroM-'-n-'O^oOLPO— cMcn'rir\sOf',-co(7»o— egn>>j-i/>gJr'-ao 
ooooooooo  — ————— ————cm  cm  cm  cm  egag  cm  eg  cmcm  ro  eon  >xmmro  root  X'T'r>T'T  >r  Nr>r>r>r 

ooooonoooooouooooouooooooooounoaooonagooooonoooo 

UUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUU 


ad- 

JJ  X 

ex  • 

• 

ZZh 

o 

II 

uj^- 

h-x 

U7X»*-t 

-JOL 

X 

— X«J 

v/j 

ex  LLi 

X 

X — 

ad 

ZX 

z 

r— </i  aa 

LJ 

- <i< 

ac 

-J 

V) 

-XX  — 

ad 

XZ 

— 

X LJ- 

UJ 

LJ  LLI 

OOOQC  • 

Zad 

1— 

Hcaai/) 

•jj 

►-H 

3 

x 

t/JLU 

X 

J'OOU 

cu 

CD 

z 

— Z.-> 

r— 

LJ 

•— « 

— eg*— t 

VI 

UJ^- 

• X CM 

CO 

l-< 

• 

ooxo 

O 

C X 

CO 

<3.X2X 

a. 

z 

X 

3X0. 

<1 

t— x> 

ad 

2L-J 

ad 

CO  CDI- 

LJ 

'-*<1 

UJ 

XX 

LL. 

-JOd 

X 

UUUli 

LULU 

X 

Z LJ 

«L 

X 

*— # 

V- 

zx 

X 

— «x 

< 

UJ*-. 

X 

XcOX 

a 

UJQd 

X 

xacxoo 

03  UJ 

a^hQ 

h- 

X 

LJ 

>z<x  X 

U5 

JL 

1—  XI— 

a. 

<\a. 

h— 

X 

z 

X lu 

U-XXX 

*— ♦ 

X 

f— 

LJI— LJh- 

• h- 

00 

*— » *— . 

X« 

— » 

-o 

< 

xo>3: 

XCT 

— • 

•J 

X 

X^dQd 

4 — •* 

-) 

*— 1 

— J 

x<ixx 

CM 

-CM 

— • 

J-.— * 

Z O0UJ 

O0w 

M 

• 1— 

— h- 

3--  X 

*< 

wQ 

b—t 

+ 4*  <1 

Z XO 

UlL 

- J 

JJ 

QX<3 

ULj  -J 

x 

<o 

— . ^-xx  X 

hHh 

x< 

-JO 

adz 

f— 4 

HJUO  > 

-J  - LJ 

— O * <5. 

<Z'J) 

UJ  — 

nJ- 

4-  + - -— O <1 

xa  -♦- 

CD  — » u. 

g? 

- 

I^> 

-0  ”5—1  <M  —4  x 

o zxx 

<'iJQJCMU-  -J 

— — * 

XX 

u 

► ►w^LJ 

— — oox 

— Z— ZLL.^<*. 

LJ 

oo 

— 

h- 

wMCUlUhU  h- 

z^x 

•*  - 

► • 

i2T 

w^l— H-  l—XLO 

O x<\o 

h-i— cm—  - *x 

— m 

ZXO 

o 

X< XX 

ill.  z 

Q 

CX  • 

XQ.cd 

o 

Q.Hli.QiQ<(JQzr 

ro  ZH*o  •<  X 

QCllj  -*-X<l 

o 

X <i  X 

• X 

X<X  o - 

~^o  — — x x 

^^h-z-coa 

Z'lO 

— *•*  ► 

—» 

Za:<  tl  »i  — — •* 

-o—  -Z  O 

O X <*  'V 

— 

— • 

’J'X.V) 

Z rM  - Z— *OX 

— » INJMU>  ► 

OX  ^UU.CJ  J 

"J 

Z<x^ 

1 OLJCD 

X 

-Z  II  II  --iCvJOO 

— 1 — ooxxz  — — 

X</5 

• 

3L  — -» 

0 — 0 

•— 3L  OO  • *0  — 

-rgo  — <X  X 

Z ZU-»J-»U 

UJ 

— ■* 

ao-vOM 

— 

— xxluiu;  vO\ 

•nO'*^  OX  | II 

— </5  «_J  CD  CD  CD  UJ 

_J 

II  X • 

UJ 

~ 1 

II  II  ”5 '70000  **N 

— <►—  •■  v/nnaj 

5dO 

• 

<o 

mra  irizz-o-w 

• 

► ►►•*•  • >0"^ 

— CM  ”5 

DI^Z^ZZUJ 

x— -52:— 

->  z 

Ql  •-•  —<  —»  rvj  CL  a.  — f— 

— 'whX^UJUfxJZ 

uhzaoaua u 

a. 

CJ'-'O  II  It  IXKf— ' 

X 

II  -liS)UJ<  X J>  Z CM 

UL  OJiiiiU. 

z 

II  cm  LJ 

I'rhh 

l— XXi 

Z'fvuj<iujuj<ii;»—  a_o 

ZZKi.U£X<l  U U — 

uj  *.xxzzr— ajw 

H 

Z 

JUh^CL  *— * 

w 

h«iif"t"-^4HaJVwH4UjUi  H 

•LJWLJ'-'^.<4U.^LJ  U-46dLJLJC-JU.U.L».LjX 

U.UU<L-iv‘^U.UO.ur^ 

•^.xxxxxx  — A>JX 

xt— ljljlJcJlj*— *~* 

XOlJLJLJZ-*U.LJ  — 

— ooqc^olu.— »*-*.*ll  - 

H^oa.i.uiyi^4^u 

Z 

— <g 

— CMP  I 

UJ 

O 

— • 

CM 

n i j' 

>T—  a^gjLJ 

LJ—  l\l 

*. 

in 

LJ 

M"  LJ 

— *— • LJ 

a. 

LJ 

O 

o 

LJ 

gj 

o 

gj 

MSI  AVAILAB 


di  r 


lL  UJ 


rOPY 


35S 


mmm  »»*w> 


1 


OOUOUOOOOCOOOUOOOOUOUOOUUOUOOUQOUOOUOOUOOOOOOOUO 

cr  o ^ r\j  ro  >r  tn  nU  co  cr  o »-^  f\i  ro  nt  m >o  r- ao  u' o ^ (\i  m ^ ir>  >o  r- ao  O' o ^ f\j  rn  >r  m od  o' o ^ <n  m >j- ^ ' 'O 
>r  mu  unu>  tn  uMiMi  mx  mi  >o  sO'or^r^- r»r- rococo  cu  go  cu  coco  uu  coaler  CT'  ocr  ovpct» 

OOOOOOOOOOUOOUOQOOUOOOOUUOOOOUOOUOOOOUUOOOOOOOOO 

oouuuuuuuuoououououuuuuuuuouuuuuuuuuuuouuououuuu  1 


-J  OJ 

X 

Z2-» 

CXJ 

uut— 

COUJHH 

2 

MUJwJ 

2. 

X *-• 

X 

t— C/3  CO 

• <*«! 

2 

U 

X Um 

K— « 

CJt/JQl  • 

t— 

— ‘CDQ-C/3 

o 

aj 

X 

vr*  ")ou 

OL 

— < 2-3 

X 

•»— «>  * 

u 

- 

x 

oqujo 

<az«-u 

a 

— * 

2XQ. 

2 

• 

»~tX>- 

IS) 

</>  cot— 

OJ 

UJU. 

uf. 

*— « 

ouaa 

U 

f— 

O 2U 

OC 

<x<ll 

CL 

X 

fMUJ 

X 

—4 

colouj 

CO 

ajsiuoo 

2 

< 

aDhO 

►—* 

CD 

>z<x 

CO*-4 

o 

t-  XH- 

(/> 

CM  CM 

CL 

VM 

M 

a. 

m 

u_  XXX 

XX 

CM 

LJ>— Xt— 

<S) 

t— t— 

o 

CO 

2 

LJ 

a:o>3: 

O 

ao 

*— 4 

t— 

UJ^JC 

o 

oo 

X 

U<ULiLU 

o 

U 

2 '/;UJ 

LL 

— ■»— i * 

2 

o 

3 —<  QC 

u 

vOO 

< 

— • 

2 ujo 

— 

* #• 

X 

X 

UX<i 

X 

oc 

* -fr 

CO 

o 

a. 

f—  h— t— 

CL 

X 

H —4 

• 

x 

ZD  • X 

O 

CD 

• • 

UJ 

in 

* •* 

CL  X *4— 

— — » •» 

2: 

oo 

:> 

Is-  • 

O-JOJ 

>o  2ujx 

X 

-fr  ■* 

>— 4 

•*  P—  —4 

•*  ^ 

f-4  •— 'OOO 

••  ►w 

2 

m m 

1— 

CM 

•*  'OJ  o 

rgcvjuj 

2— UJ 

HHUJ 

• • 

<x 

CM 

•OJ  • •. 

■— ’■^t— 

a ilk'x.o 

X 

c->  1 

o 

— O *-*  2 

UJ<  < 

t-(\JXX»  2 

UJ<  < 

X 

• • 

'Ll 

ooo 

O i^OU  •* 

U.QC 

o zv-x  •< 

O-Kxa: 

t— 

Q-t-t- 

2 

• *t— 

•*  -R-  t—  • • 

<-» 

eg  a - -*x 

CLC-J 

• 

o.oo 

• 

oc 

*— » — x 

a:<  '» 

•O—  »2  X 

zcL-t  ti 

— • 

C\J 

2 • • 

w ooo 

>T  nixiu>- 

•• 

vTX 

*» 

•—  — 

ULX 

o 

*y.  • x «c_v  ^ 

it  it  — 

-<-*00X002 

— <— « ii  ii  — 

oo 

-4O-3 

uo 

II  It 

LL  —■*  X IIO 

i? 

*040— <cQ  to 

o 

O —4 

^ •• 

0-4 

X —CL  | O 

— — Q. 

>r  *vy\  ox 

1 II  — — CL 

>o^ 

II 

l|  »— *-< 

— o 

<T  1 OO  — 'O 

nu'J*^K  •^volucd 

’5-)U( 

X -N^ 

-)—)  9 <r 

*r  -x  • <ol  *• 

* •*  *vn 

X'O  — <l-0 

— «0  * •* 

»-«X 

”3<«q.x 

- -GDCNJ 

CM  -f  DU'J'J  • •‘vO 

— *wH-X<tUJ— 4 

— IZ  CNItMfM 

• 

• 

U_u- 

UJQ. 

2^UJIU-4  — w 

www crM^uj<  txi > £.  in— wwo  ii  uj<ujy'00~r— i_j  ii  lu<!Oww  iuoiou"  • • '-•uj 
uj<iuj*—  icta.*!  ii  ii  — u.j<uji—  1-i.aiM  f\j<r <;  t—  zl>—  t—  i—  i—  i!  i.a.  n «^i— 

I — u_  r—  w«,MliUJUX  11  | — U_  I—  aj>— >QL<1  II  II  wwijjwti.  U_  I — w l|  M 11^  ww  LL 

<*  — 4 <4.  X CA.  U- U_  X OJ  LU  'M  LJU-U.<l,iiUU-J<AU.  X U X — ' «-L  U_  — * — J CX. 

22LJUL<lUC.X»~'_£LL  J 


— rsj<n 

— 4 

(M 

n>>y  rn 

u » 

x >r  x 

— 

CM  r<)N r 

—4 

—4—* 

— 

— X CM 

O eg 

\M  rgvg 

o 

o 

O 

o 

o 

'O 

i 


BEST  AVAILABLE  COPY 


r 


UOQOOUOOUOUOOUOOUOUUOOOOUOOUOUUUO 
i"*  co  or*  o — c\j  o » >r  u > r-  co  <t»  o *-*  f\j  ro  >t  u > x r*»  cd  lt  o ^ <nj  fo  ^ in  >u  r»  co 
or*  lt*  or*  o o o o o u o O o O •— 1 1 *-h  f-«  *-*  ^ *-i  r-i  • ~4  *-<  c\j  i \j  i \j  c\j  i vj  r\j  oj  c\j  c\j  c\j 


UQOOOUOUUOOO 
— c\jrc)>rm-4Jf^<X)U'0'^('sj 
ooooouoou^.- « — 


oou—* 

.— 4.— ^ — — *-H.— 4 

*— J r— 4 I 

— 1 —4  r- 

^ Hi- 

OOOOOOOOOOOO 

OUOOOOUOLJUOLJLJLJOLJLJULJLJLJLJLJLJLJULJLJLJLJLJULJ 

l-H 

H-*MM 

I 

I 

I 

I 

I 

I 

U) 

>-  XU 

LU 

HUUJt-i 

M 

X CO 

ZCCK 

H-  *0 

QL  — — <1 

• • 

- “3 

lj 

UJ 

X 

U-  •‘O.CJH* 

LU  — 

ljljlu 

IUJm 

CL  X 

iha 

4/)  ULOO 

>•»- 

x >- 

UJl/) 

r— 

UJf— 

— ‘XXLO 

U. 

aJD 

>— >— QC—4 

QC— • 

O— >00 

-«<LJX 

o 

-*3<1  — 

uh-ur- 

LULU 

U) 

->  X 

•— *v/» 

LJ 

> 

• H- 

CD  UL  QL 

lO<l 

<1 

*-»u 

C.  ^UJUJ 

LU  J 

X 

— ,>X 

UJ— lULL 

— LL 

X 

— — c 

O QL 

1- 

< 

sr 

•1—  X 

^h<Z 

— 

•> 

- •— « 

U.-J— »UJ 

— JUJ 

• 

O 

— • 

m 

v/Jl/3 

-J 

— 

X 

2 

LT 

•• 

UJ  l_JUJ 

(JJL')UJ  ►— 

<u<* 

> 

— • 

CNJ 

au.-i 

<0.  r— 

— 

X 

•» 

>2H“ 

~*a:<i  oc 

OJ 

h- 

CL 

LJ 

r—4 

1—  LJ  — 

u-  JC 

LJI/J 

»—< 

u 

h- 

2 -J 

o>-  •* 

QL-Q. 

00 

OO  LJ 

II 

<1  — 

Z—JUOUI 

Q-X 

o 

2 f- 

<r0 

<U-lLUO 

X 

z 

•*  00 

“3 

u.  < 

QL^XO 

OZ 

2 

►— • 

— 2 

□ XU 

CO*— «— 'O  <j\ 

20 

O 

< 

cr 

CL 

DO 

— JK-  (M 

2 

H— 

W r— « 

U 

><xa 

LU  CJ 

Xf 

CL 

m lj 

X 

►—  X IX 

ul 

LJ<. 

J) 

UJ 

LJ  »- 

'J' 

r— « 

LJ  — K- 

►— * 

u 

r—  u) 

LJ-3 

-ICJLJ 

X— »ULi—  • 

<3.— * — 

in 

</)  2 

!-□□□ 

^OJZ 

3 — ih-CJ 

iX-J» 

m 

UJ 

00 

2—  - 

(/)»_»— u- 

CDO^ 

* QL<ZO 

CO  <1  • 

4— 

Ol 

••OLU 

2001/3  00 

<IZJ. 

LJUOLLJ— *UJ 

*-o 

U 

< 

Xi 

-OH 

-2  2_j 

OJ-Q.UJ 

LUQLCCCO 

h— 

□L 

»-H 

oo<i 

rn 

UIZ 

LUX-LUJLJO 

XCJU40J 

u 

— — K- 

□ u.  XX 

aco< 

ZHua^  • 

►"•2^ 

o 

U» 

< 

w-^oO 

HUGO 

a-  x 

u — ju)ixm 

LU  O 

o 

2 

— • 

OsJO  — 

00 

2cu 

u.  • 

XQCZI- 

u 

»— 

OH-  •* 

2222 

□ UJ 

• •“<  ujh- 

LJ 

u 

►— * 

LO  — 

-uou 

2 LU  UJ 

••c>-  -J 

XU 

r- 

H— 

2 

^ ja 

LJ  — — — 

— (OX 

*Z0Cb-  LU  • 

x **-o 

— » 

O0 

H4 

2 «“2 

1— oOi/)LO 

X »— 

OLD—  • CX  r-t 

o- 

“3 

<1 

- •* 

00222 

Ul/3 

— *^-J>-LJO 

LO  *-QC  — * 

•> 

UJ 

X UJ  CO 

— Of\JQ ILUUJUJ 

2<3.h- 

h-  —*  Qd  X • 

vOUJO 

— 

• 

— J 

<12  — 

U02X  »-AXX 

<X<* 

_jooaj<  oolu  •*—  • 

—* 

o 

— < O •*. 

at  X 

< «-i<uOLUZ 

•■xcNKin 

< 

• 

»— 

— »-UJ 

—4~4 

“.jjacra 

CQ-  h- 

— »o  COoOCO< 

— H-^UJ  • XX 

< 

• •» 

• joOlu  • 

- UJ  O'  L-  o.  _ J 

X -i 

• 

mQ<00 ^ 

£oO  II  tl  II 

•*— Q 

— * *-cotiuuo 

— - •*OU2<t 

f\JU  • 

— * •» 

>c^-oo— 

r^- ><  lj  u. . u — j • ujx  • • 

•» 

— 

— ojv)V)vpv 

v\"JUU 

o •*-  - urn-  2-jmoo  oor^-  — ii  —4^-3 

— «•  •*  • O — - u f 0^00*-.* 

Naxiu  'O  XZJ  • * II  — MU'-* 

Na0^u>  ►'n  <1  - r—  '■v  a.  • vu»  cjuu  wiaj 

— * •O'C^^OO")  *PsJ  — *0X3 

►“ON  <NhX  — 2 »— 22 

<>-'OCDOUJ<  •*-  Q — lu<  c_j-  •*  r-w(j  ii 

- f—  31  - uco— lj*-x“>  t—  K-r— rn^cLh-  — > 


X 

xuc\J  — x X r—  X.—  X (XI  2 

U X «-H  X L_ » UL  U X UU  2 • U-  X V_J  - UU.U-4U<4VJUU 
xu^— ><J/-*olx^x2  — j:ll.  •*«  <i  lj'-’ljlj uum ua  — _*XXlU 


oo 

O — 

•>  ■>* 

II  UJ  < UL 

*-XZ> 
CO— X»— L 

<4  IX.  V»JWfcJ  4 


DMZ^<UO-:hh 

ujoo  oouo 

2 ZZZ-UJ«^JO 

— mojuuajcocn  aa^ 


JX^^i/iZZZ'U 

ukzzzoouv) 

UL  XXXXiX 
UJ  4.XXXXX 

^ • • — •—*  — l_ll  J\_l  •* 
<✓/* 


II 


— <Mm>r 

— 1>J 

2 

2 

X» 

mj 

OO 

r-  x u'oj 

— u \ — 

X 

X 

L J 

(\|LJ  1>J 

u 

<m  t>jor 

'T)  O » LJ 

X 

X 

OJ 

O 

Q 

o 

X. 

X. 

'U 

>o 

O 

u 

o 

u 

u 

UUU 

UVST  AVA11A81E 


357 


oooooouooooooououuounouoouoouoooouoouooooyooooou 
rn  >r  ao  ^ o ^ ^ m >r  u a oo  O' o f-»  c\j  m >r  vo  aj  cr  o »-<  rn  nT  'i;  ao  o' o r-i  rvj  m >r  m oo  CT' o 
— » ph  —»  *-»  —»  ^ -i  c\j  cm  imcm  * m cm  t\j  im  cm  cm  o ) m m m m o ) o > rn  n i m >r  >r  >r  >r  >r  >r  >r  >r  -4-  >r  in  in  in  in  u un  in  in  in  in  o 
ooocjoowooooooououoooooooooouooonoooouooooooouooo 


UJ  <X  *-• 
X.  -X- 

DUO  UJ 
LJUJ  — LJCJ 
OQL  ^l/)UJ 

<4.-  ro  — Hu 

OX  — 
20-  *cO 
<l~*  X<3. 


►o  ico*-* 4p— 
□l  — <1  >.»-* 
ZD  •‘UJ-  2 


• 

2-  OO  — 

O 

2 

>T 

CJ  iu 

1— 

2 

uhi-ZZ 

CO 

CL 

— jco<i  0 — 

2 

CM 

*— 4 

< — 

O 

• 

►uj  uj  c/  ro 

LJ 

h- 

CL 

icu2i— 

2 

CO 

O 

•—»  uj  v/  I 

2 

• 

21—021  O 

2 

— <l»—  *u- 

O 

► 

• 

O—* 

►— 

'T 

O 

(— 

►UJU.UJ 

CO 

—4 

h- 

O 

2T3DCXO 

2 

CO 

• 

—•2  2 

-4 

(*) 

<UGUJ< 

CO 

O 

2 

Zhum 

a: 

h“ 

CM 

CO 

a 

— j 0 

0 

QL 

H— » 

22  or— 

h- 

a 

U 

'JJ  U 

• 

O 

0 

1— 

QC 

02  2 

UJ 

— O 

a 

—40  < O U- 

> 

— 

O 

UJ 

• 

O'l  UJ  — 

>—4 

O 

a> 

— 

1—  H-  UJ 

0 

W 

K- 

CL 

cno«— 2 0 

0 

>T  — 

— 

Ul 

222  2 

— « 

O O 

CO 

• 

<r— cj< 

cO 

0 f— 

♦— 

2 00 

CO  —CO 

| 

</> 

•J 

OQ-2-JnT 

>— 

— 2 22 

• 

— 3 — <1  •* 

X 

— wQ_ 

— 

•u 

— ‘H* 

CM 

002  m 

0 

— + — 

— CM 

X 

2 

20‘T>  - 

w O * 

~D 

-f 

t-  UJ 

X 

iuuvy<i  cm 

a. 

nT—  »~h- 

^ 4—4 

—1 

1—4 

ZiJI-Z  - 

OU>—  I/HJ 

0 0 

0 

• 

►—  HJI  *H 

UJ 

I-  — — 2 • 

►—4 

1—  1— 

— *2 

— UJ 

QC 

hGI-Z'J 

X 

CO  — w —4 

CO  CO 

•X 

OCMOlLU*—  h-  II 

>— 

2 »— 4— 4^»  ^ 

n 

2 2 

CM  II 

UJ|- 

• 

-izazow 

•OOiC  1 

— — (M  • 

O 

2 

— 

* - —zr-i~) 

UJ 

iHH  **2 

— 

r-4r-4  ^ 4*  UJ 

•UJ 

• cl  >r  — * - < 

2 

X^OcOi.  — 

2 — 

2 1 | — - c/)0 

CO  — 

— INI 

12 

— 0X2  G10C 

«— « »Hf-«  ► 

► 2 2 2 ••  •—• 

»«— 4 

rvjcj  —•►——4— • X—  • 

2 rJ 

*-*»—• 

| • 

-CO  O*— »CMOO 

-J  CM 

to  - a. 

— «C\i— — — 2 — — 

— 

Q_  — J 

• *—  vj>0  — 0\X 

<X  II  1 

^ 4—  11  11  2—2 

M — CMPsj  11  II  —4 

II  CM 

2«I 

J-»^VN|hQ 

M II 

w w— w 

II  0 

II  II  000  II  — 

LO 

• 

• NOl^4  “5 

r— —u. 

1 0— oa.— 

p— 

— P—  p— P—  — — 1>J2 

— t— uj 

— h— 

*—  2<X2  — 'U.—  — 4— « >o0 co~0*/> CO  — O hi/)hiJm  2 

" I it  O'jzai-i-^  Q.2T2: — ■«;  wa-wa-i-  zo-n  zzz  — i— o— z i—  z <\i— 

l-f-u<iil<ZZ,JMu«H  »o  -4CN  — «t/ir~— ,^ivv  c V'  — <\u/1— ir^j— Or/}—. -h— irg 

i_it—  3 o ii  —•  it  joui- ioz-«j  3o<mii  ii  » -<  ii  ooz  uai-z  — 

zzz  *.  3 — •-*-  <_i  ►— • i/ioji—  r—  —ii— i—  —ii— — r—  ii  i—  r-  r-i—— ■ lit— i—  — ii  i— 

^aauuu.u.ixu^'j)xwa«"u)4.uv)vu)v)^wiu.uv>  '✓/l/jlj  — » iv^/u.  v;v/mjuu  ••  uvj 

2a,r-2iUi«»o^^U4''^  0 2<*-22OX  2 — 0 — it  2'—  2 2 2 0—1-0  UJ  2 
— <Mn  > >3-  ^ 2 

ivu  UJ  >r  vjj  r-  aj  cno  — ».u 

-'U'  2l  — — • — — — CM  1^4. 

o i.  3L 

mo  lj 

o o 


RfSl  available  copy 


J 

I 


cu 

o 


— * 

*— 

-H 

o 

1 

ok 

—4 

o 

i -«C 

•— « 

o 

o 

M O 

*r. 

i— — * «— * 

— * 

— * CU  CD 

— * 

vUH 

•»> 

—l  Q— J -J 

U) 

o 

* 

w O • r-  + 

*— * 

«r\  — • + 

— * 

o 

CJ 

O J 0^4 

O oj 

—4 

l—  — *uj— » »^* 

1 

—•  —4 

o 

a 

iS)  O -*  ••— 4 I 

0*1 

•-*  X 

H— 

*-«  O 

7 fc—  1—4 

0—4 

-J  >— •*— 4 #•— 4 O '—4 

o 

C H- 

O 2. 

tCm  ~ 

••  •■— 4 O 

Ow 

> — 1 JJ  * 1 P~  4L_ 

— Z + ZQ  *X 

a 

fr—  + 

a 

•»  1 

v 1 

o 

Or-4*  a z 

-^UJ 

O - •Z^CMOCDS:  4-4 

C 0-4 

X ^ 

*“4*  •‘(Nj 

1-  cOm-*<w  OJ  » 

— » 

o *: 

3L  C\|  r-i 

— 

LJ  »“4  *. 

^ | l»  — * II 

— tl  Or-4  M 

—4< 

VJ  J a •#  II  i —•  ii 

1 f i-^  r\  | JX  a > j 

X A — 

_J  X X 1 1 

+ XX 

ll  ll  x x x 

II  to 

■ * I * l X "H  4 

Q.  II  ||  — 

X 

O 

— • * A,  — ' 1 

n 2 

'»  " T ^ 4L 

fflCE 

Ll 

ou  — • -» 

M 

*— *“4  OUJ  •HQ.  JU  4-^H  1 • + 1 *0 

■J-JJU+  1 

ir>  + i in  + 

UJ 

►— *l_3  ^U1  — 

♦ 

LU  + Q.w 

1 

■w#  ' ■ 

XUJ^4f\|— JO 

“J  If  ►— « 

.QwO  ♦ lJCNI— 4 

/ V— ' IU  w 

JU) 

«UJ  • -<CnJUJ 

-4- 

r-4_J  0^>~  • OJUJXO»— LU 

i.  •**  4ZOOUJH  i£* * — 4 **  JZ 

w 

0 

0 

• _i-*  uiroait-  • o t-x 

X -« 

^Hh-  2_ 

o o 1-4  LJ 

ii  ii  *-4<*x  —*<1 

H 

II  -J  4-4  11*-**.  II  r-4  II  < 

II  A.  II  II  * II 

II  4-«X  II  II  ||  II 

II  H*  II  II  h-  H ►-  *1 

H-W  II  »— 

II  II 

^ II  ||  I— w J— 

II 

«**  w 

r-  ii 

* 

\-jUI  V-J  OJiJU  UU.U.O.  V/u.  AUWIV)  AU-'-'"JU.  Adjur'd)  XI  M i— I CU  l_J  1 M l»J  OJ  V-J  U» 


'Ml'  I >T  Ut  sO  4J  'U  l^»  UJU 


359 


. 


oououooonoo 
O'  o eg  m '■r  in  r-  ao  lp 


0000000000000000000000000000000 
o —4  c\j  rr*  >r  u 'i  so  r-  co  CP  o ^ eg  m >r  m >o  r*»  a>  or  cj  — « (\j  m -t  in  o r*-  ou  cp  o 
tN  in  (\i  c\j  (\i  c\j  rg  rvj  rsi 'vj  m r«)  n ) m rr,  co  ai  rf>  ro  >t  >r  >r  >t  >r 'T 'T  >r  ^ m 


— 4 

U 

h- 

•» 

2 

I— 

<1 

• 

M 

2. 

UJ 

II 

u. 

a 

cu 

a 

o 

l/) 

lj 

o 

*-H 

V) 

<1 

f— 

K- 

-J 

LJ 

X 

• 

3 

2 

a 

*> 

OO 

LJ 

LJ 

LU 

LJ 

—4 

(X 

X 

<1 

*— • 

u— 

•» 

tU 

2 - 

a 

— 

X 

U^ 

2 

1— 

CJH- 

< 

II 

— > 

J2 

lo 

UJ 

— 

X 

— 

»— 

UJ 

«• 

a 

V > 

2 

X 

vT 

LJ 

2 

i -y 

LJ 

2 

LJ 

W 

H— 

I— 

— O 

-J  — 

— 

oo 

h- 

• 

O 

2 

►OO 

M— 

1— 

o 

22 

1— •— 

to 

4* 

o 

•— * r\ 

•^2 

2 

(\J 

<!*-• 

2*- 

— 1 »* * 

/ 

2. 

— 

VIV) 

UJ 

2 

•• 

»—**—«  ^ 

20 

2-« 

— • 

t— « 

— — 

*— 2 

>— » 

(NJ 

cNen  2 

—4  —4 

<i 

LD 

OO  Q*>* 

— 

XX  — 

ox 

Ol— 

h- 

>— H-  h-<N 

•— « LJ 

2222 

a — ■* 

H-O 

l-oO 

< 

i/)to  O 

^cx 

► »*•»* 

2.  2. 

00 

OO-J 

22  0h 

C\l< 

*-^  —4  —4 

•»  •» 

20 

-IX 

oOl— 

* oto 

OO 

11  11  1|  11 

»—4  —4 

to 

M 

1 — 2 

H- 

—4*— «*—«—« 

M II 

20 

2 

-2 

lj  — 

ooO 

f 

t 

» 

f 

M •— * 

OJ  <1 

— OJUJ 

4 

— •—  lj  i 

22 

^ •* 

M v 

> 4»-«CD 

LJLJ  »— 

►— < 

— ♦— 

— . — 

00  •* 

X0O2 

X 2 

~2  oo  — 

I 3: 

www  w 

2 X 

22< 

2*— • 

lj—'  -J— < 

o 

— 4<\irn  -T 

W 

uo 

*-UJ_L 

2 sf  XX 

— _j 

oooo 

o o 

'“I  X ^-4 

tMIU 

-4  ex 

wo  —‘•-•2 

—-j 

-If—  h- 

•— •'V 

O— ’ 

oo 

f\lh- 

v0  2W'/)t/)«/) 

to  oo— 

1 ao 

H-ao 

►-x 

Ooo  t I— <\j 

r 2 -j— 

-y)tu  ^ 

OOUjI/) 

o^tx 

1-2  OO 

O 3 

«— W**  W 

w wO> 

— •— •c^»— » 

2X-J 

2UJ 

</i  _i  «t— .zi— ait— 

*— * 

r-4  » •» 

- < 

* 

l|  — O') 

►IvOlUJ 

•-4—  r-4— 

X—  •- 

— *•« 

— * ^ 

II  -4^ 

— xh-u.u^uunu^u.u^auix 

2 — ^ 

i\4X  <► 

mx 

1 ii  — a. 

onouo^uozoni 

'-O'Oh- 

U'OOJ 

U'O 

O ii  —2  II 

l|  II  LU-^ 

ooooo 

'—OO  — O^ 

—40-410 

0—1—4 

LJ-4 

CD- •— «<N  — 4w 

O fN  f\i  eg  (\i  c\i  eg  rg  cj  eg  o — 

om\»< 

o^»— 

ox* 

♦-♦OOLJ  — tOXCNJ  — 

—-'•lj  • 

o •«  **o  •*—  x. 

r—  •*'N,LU— * 

••x. 

0 — 2 — — -)2'^2 

•— *31> — O^OsO-Ov^f— vijgjh—  O'*-’ '*-' 

^4t0>0— ’-J<N— * 

|>0^— 

— «'Uw 

- - ■ 

ro^O'J’ — <Ncom^*r,x  • 

a i ai  uj  ai  ai  z uj  uj  z lu  *a.  < ql 

II  ai<t—  On  OKI—  ll. 

II  UJ<1 

II  UOKUh-U^U^U  2 

1— 1— 1— ►— 1— 

»—  h-  1— JLi-3 

II  1 — ac  -dl— 

1-3-013 

1-2.- 

— 22LJ2LJ2 

*— 2U^ih-— • 
2 

JU.UU 

JEX-JX 

—4 

»— • -ix  *-4XX 

— IM 

n)LU 

in  sj  >r 

•—4 

U \ (NJ 

^ rn 

— 4— • 

— '2- 

LJLJ  —4 

OP 

—4 

— • —4 

OO  —4 

o 

— * o 

-4  O 

o 

(\|IN 

rn 

rr> 

m 

BEST  AVAILABLE  COPY 


360 


oooounoooooo'Joouooooooouooyoouoooouoguooooouoooc 
— 4 »\j  m in  >o  ao  O' o ^ c\j  m >r  in  >o  r- oo  O' o »-<  fvj  rn 'T  in 'O  Is- oo  cr  cj  ^ cnj  ro  ^ r- co 'T' o ^ rsj  rn  >r  in  >o  ao 
o o o o o o o o o — i ^ ^ ^ -*  — » —♦  c\j  i"vj  <\j  <m  i vj  rsj  cvj  ru  c\i  v \4  cn  rn  o i on  cn  n \ cn m cn  cn  >r  **r  >r  >r  >r  >r  >r  >T 

OOOOOOOOOOOOOOCJOOOOOOOOOOCJOOOOOOOOOJOOOOOOOOOOOOO 


> 

LU 

>— 

<* 

H- 

U) 


UJ 

LJ 


X, 

o 

(\l 


z 

UJ 

;> 

*— « 

LJ 

UJU' 

ru^ 
•2.  -T 
30 

zr- 

uO 

UJZ 
h-  - 

H-O' 

uO  — 

m 

UJU 


o 


oo 


o 


-L.*—  u> 

LJ 

h-i'J  Z 

H- 

Z-«*  - 

00 

-O  **OCOIU 

z 

LU^O—'I— 

•» 

v-oo^<i 

rO 

LD 

fMOwwt-LO 

H» 

^3CMO<I^ 

Z) 

njUhH  ► 

Z 

— 4 _J»— ‘vOoO-^UJ  *• 

nu.hO 

»U2  » ^^i— 

Z — •*-  oo 

*1  uj  o co  cm  oo  —I 

► •K\J 

*k-o 

^Z3-*—i-ZCj>- 

UCJOO< 

Qah-f-  >-ZZZ 

-uaji/^uii/»>v^'N. 

DZ^*-<clu 
ujoo  ^ 

2 Z2!  Z _J— J— J c 

-•^'J'JUCD'UCDO 


UJ 

K- 

— <1 

— h-CO 

'U“0 
H-  LJ 


m 

— c 

h- 
!U 
I— 

<\ 

I— 

»/7  — 


a 

LJ 


z 

X 


>r 

c 


*-*o 

o 

I 


-<x 

X 

o 

XI- 

3oo 


CKOiZO 

• 500  IOSH 

2:  LJ  DOD^ 

LJ  -JO^  O* 

—4  XO  -X-  __J  • Z • 

CL  2_  -*  t ►*^IU  WUJ 

ZDUlu  h^hZZ  -<ZX 

> 0-4-10  -«LJ  *x  o *x 


Uh- 

*—0 

0^1 — H 

z 

-L. 

H--*0 
— « II  LJ 

•“X 
X-*- 
iU*~*  •» 
O^X 
CCUJP^ 
Oh-  - 

Ot<.™ 

CL  h-  *— « 

l/)  •» 


-MJ 


»— o 
2fM 


CL  •‘H 

3x1 

Z02-  *“  * 
'JUJ^HX 
Q-JUM  " rn 

-J-J'sZO*-*^ 

* CM  •— 

z*:  — uj 

*— »0  ••  X *— *h- 
Oujm  — < 
l<-IGSUIh 

OC 

OCX  2_ 

• ox  •— «£ 
•2ZO»  ^ u_ 
X 

*cc  « — * •* 

x u— *•  (MX 

X^O>vO  **x.oo 
zovoxuo^ 
♦ i.ip>sinouu<v 


<3 


(\J 

so 


CO 

O' 


*y> 

X. 


I 


11  Z • It  f—  X.  Of-X  o • —I  *-N  O'  X. 

u.fc-^«*-NSN  21  ||  2_  11  ,|  too  tl  —4</IU?  It  — *0 

3X^>lovo2:^^:  ti  — < 11  3 — • za  2To  clz— *♦-— h-  ^t-o  ui 

GHZZZCUG  iUit  ^ -J^O  OiZO^  •LD<5Uj<  UJ<  O- 

IX  lUUJUJ2.2.Xa.^U^XLJ^lUiNiLJ  It  JCUt-  It  XLLJI—  it-il"  J.  "t-i  llt-X  HI 
xi  2.a.x-2_  42.  ju  OlJ^lj  o ^ lj  it  ^»i'XH«aaj—a  LJ  ^ it  —•’ 

« t »-UUUUUU'JJU.  UU  JZu,  UUXU.  -JLJ  XU.UQ'.UUCLUZUUUAUZLJUXa.  LJJVa- 

VJt-UUUUUUZJtUXX^-IUUA  — XUi.'-XUJL— iU.  -CU_*-»  XU-  ~30— ’i-LJXOiZi.*-»^-LJaL>-* 


—4 

nj 

i"U 

C 

O 

H 

t- 

LJ 

O 

O 

0 

-4^ 

z 

♦ X 

X 

w 

4*  w 

—0 

O 

2!t— 

3^0 

3oO 

O-i 

O-J 

X • 

XL  • 

■— 'LL 

wUi 

^JZ 

c\ JZ 

3LO  • 

O • 

*—  Z. 

Of—  X 

nT  ^“11  OO  O 

—4  000 

3L  ZLJ2 

zu 

c uk:  -IZ.U  _i 

•—  II  1—0  It  -1 

t—  It  0 

z 

uu 

•■4 

rsj 

ot  >7* 

UU' 

OSJ 

vor»  oj  or*o 

»■* 

«. 

O 

O 

X 

O 

0 

O 

0 

•n 

in 

in 

0 

BEST  AVAILABLE  COPY 


ooooooooooooououunoocaoouQouoo 
0s  o cm  r*)  >r  in  gj  r-  co  g g eg  m >r  m so  r-  au  o*  o .-1  <\j  m ^ m vo  r*  co 

in  u un  u 'unirun  in  u > >o  >o  ^ ^ ^ 'O  >4;  *0  r^- r*  fw 

OOOOOOOOOOGOOOOOGOOOOOGOOOOOOO 


OUOOUOU^OUOO 
^r\jo  1 vj*  in  -o  co  <j*  o g 
oooooouuooh^ 
ooooooggogoo 

XXXXXXXXXXXX 


ZLJ 

+ z 


z 


U- 

X 

0 

m 

g 

• 

% 

G 

l/IX. 

LU 

z 

CJ 

OLO 

*"■• 

'T 

■H»  ■< 

V) 

G 

r— 

f— • 

<lf- 

h- 

V) 

ZG 

U. 

Z 

— G 

UJ 

CUV) 

G 

4* 

X-JJ 

Oai 

a. 

X 

G 

1— 

LJ 

LU 

*— 

UW' 

U»G 

Jfc 

G 

UK 

-J 

X 

G 

cr 

•JJ 

* ♦ H- 

UJ  « 

G 

CCUJ 

az 

— G 

XX 

a 

XO 

G1-* 

at: 

G 

ZK 

CL 

G— * 

5LZ 

LU<X 

— ' • 

a. 

• 

muj 

h-K- 

a. 

GO 

< 

ID 

h-  • 

CO 

oOX 

LG~» 

G 

in  zg 

H- rg 

G 

<— * ft  G 

+ 

<Z 

G 

•*  -X 

G 

>0  — • 

G •* 

Z 

-1  la 

z 

G>- 

►— * 

- GO 

— GG 

>r  g • 

II 

Z<IK' 

ac 

■-^ 

•‘GZ 

m lj 

• 

X 

(\j  LU 

-«  ac 

■* • GH- 

ZGG 

ac 

— OG 

— » 

••z  <1 

Z 

O UJ 

X h-  • 

-J»— «;> 

a. 

f—  - 

w ucoj 

z • 

Zl-M  • — . 

G 

(Vi  •* 

G Zz 

i“4  ►O 

^IDCnfNJ 

♦-  G 

X 

K-  • 

X’^ 

COOIL  2 

a*  \ 

—0—0 

co  1 cl 

Z + D • 

l-4aiJfa+  •• 

CL  f\J~ 

X • 

-j  0 

-J  G— 

Q.  JJ  CC  — • 

x-^ 

x-*o>* 

^ • 

Gccomz 

— *-G 

^os 

1 uz 

*G  ^ 

UJLOOI-Z'- 

1 

+ x-n^ 

zu  • 

G II  *JJ  1 

Z wto  0 

• Z 

VO  • •‘N 

X.  <.\|  <>4  —if— 

1 z t- 

►«*<✓)  z 

G U — 

—*  Z LU  nU-^LP.LJ  1-*  H||XC 

♦~«<Xi\j  Grg 

G 

X I^-h- 

ua.  X — •0^  11  I-^ZZZ-<Z002 

OXZZ^I 

•GZZ 

tc^  *uj<o_j  a 0*  -« 

^•VD  CL.  £X 

CL 

UH  GZ  ^c\i  — cr 

h-  IhiKJ  if  f—  11  r-vj  II  ^ ll 

If  X~<“>  II  O 11  II  II  G II 

II  G 

U-  Z II 

G 

II  ||  W— »£X 

G 

G ^ f—  f— 

r— G 

LU  UJ  1 — u II 

11  r-L-i 

UJ  LULL  GGtU^MwlZG— lZU-^t\JLJGU."4UJ*-«'gZLU*-<t'guJZ 

ILL!  GZ 

i.Ui'-'XU.U 

«a.uiu-n«xxxuMjtaxif)(ix 

XQLUJ 

*✓)>—  <01^2.  x. 

*—U  X CL,  UJ 

ZKJ 

(M  rt) 

rnsr  u>  >o 

P-  *U  LT* 

UJ 

G 

— • O 

— « — « 

X 

LJ 

X 

n 

0 

GGG 

362 


ooouoouoooooocooouooooouooooooouoouoooouir>otjouooo 
— » t>i  m in  o txj  (/>  o ^ (\i  m >r  ir> -o  r>  ao  cr  o (\i  .-o  in  so  oo  o' o t>j  m vr  vO  r- ao  cp  o (\i  tn  in -o  oo 
cj  o o o o o cj  o cj ^ -h  r\i  i \j  i\i  r\i  ru  eg  osi  rg  (m  i m n ) r>  i m rn  o i m rn  m 'T  <■  vr  >r  >r  «j- vj- -r 
ooouoqu'iuoooooqooqooooouoooooooooooooooooooooooo 

oou'jooouoijoooauijoooijociouuocHjoijuouijoiJuooooouooouo 


o 

* 

LU 

UJO 

• 

h“ 

oo 

o 

2 

hH 

xox 

• 

<l-dl 

o 

o 

— 'XLJ 

O 

LJ 

o 

rH 

LU 

m 

ojcj— * 

* 

Z 

z •* 

A 

t—* 

Z 

o 

o 

< 

k— « 

X -U 

«— in’v 

H— 

h-^O 

»— 

UJ 

02 

in 

fsiC— 

o 

< 

o 

cOO  •• 

2 

2£*-  — 

h— 

z 

ljoul. 

C 

w a. 

— » 

UJ 

UJ 

o 

*— * 

XU 

o 

u 

U 

o 

— « 

JwU 

h- 

IUO  1 

• 

o 

Z 

02 

C2U 

< 

o 

o 

UJ 

UJ 

o 

<^a  - 

OO 

o 

o 

a 

> 

H— 

L)U- 

UJ 

•— »o  • 

«— 1 

*— 

LJ 

CL 

z 

<r 

UJZ  •* 

h- 

w • — * 

* 

• 

LU 

u 

CJUJ 

nj 

dL  ••UJ 

►H 

aifi'- 

u 

in 

J> 

o 

Of" 

*—« 

O 

• 

■y 

< 

C 

uH-o<a._j 

—►-CO 

w 

UJ 

a 

□20  O 

■■»  1 k 

H- 

COOK 

UJO 

><r>J  u< 

a. 

u; 

20 

LUX  — • 

•uoo 

ooOOiynuLJO 

Z2  • - 

•k 

UJ 

• 

• 

- 

h-zt 

a x 

X 

•-•in 

a: 

I- 

nT‘ 

•» 

— **sUrU 

o xo 

X 

LJ  CU  'w  ''x »— 1 

•u  * 

U- 

UJ 

•*  ox 

»-<X  + 

•*  • 

•> 

UCLUJ-JU?^ 

*~4  *— 

*— 

♦ oo 

OOCvjuj 

luu)  *:<  i 

o*  — i 

■wO 

oo^ 

x 

Z ZJM(^  II 

+ .2 

II  UOX 

X 

• fMV. 

(M>VUJ<U2: 

• II  CL 

• ti  ii  ii 

II  4-  O 

►-«  <j  > u uj  »—  oo  r? 

LJ 

o 

<i_i  ♦ 

O 

UJ 

r— 

u 

it 

1— 

02  • 

O 

nxuONtoi^Oi 

LU  + <\J  w 

S.OOOOO  — o — 

02:0 

DIW^ZO  •”)— <2  IZ  ‘Z  — l<t  *<110  * 2— H-  2 — < • • • — < “50  2-* 

ut—  2cj*->cyo  —io  o on-  uo  «i-iC)a;uj«io~uj<  n oz<MOZ->f»  m 

u-  uja.  — • ii  m ii  i—  it  ii  M-  out—  ii  — • i— uji— i_i— t— i— i.  it  ii  2-*  ii  i-i  h ii 

uj  *.  2 ii  ii  h—  ii  ►——»  it  — ••—a.  21—a-a.  n — iiwui  oj 

— ' ..i-<i_)  .•  ••ol£2*l.  02.^  O u-iiu  u_~»u.  UU-U-UUUIXUUA^.  u. I_J  igouu^u^.^. 
l/ll-UUr-l-QLUAi— UiiUUW—UJOUlliu.— "Ui-iU.OUJU.ltliUi-UU—UUU^Ui.i 

2 22  —i 

UJ  UJUJ  ivi  t"')  <4;  y (j  ^ i\|  fri 

*.  i-t-  o -•  O — — -•  -« 

2 II  o o 

a OCJ  eg  eg 

U OO 


363 


BESI  AVAILABLE  COPY 


OUOOUOOOOOOOUOOUOUUOUUOUOO 

O o ^ <\j  r» ) tr  >o  r- co  o ^ rsj  ro  >r  in  vu  r- a?  o (\j  rn  >t 

>^mir\u>uxincnirunirun>0'U'0  0'U'0'U'UsO'Ur^-pfcp-r'»f— 

UOOOUOOOQOOOOOOCJOOOOOOOCPOO 

U50<JUOUOOUOOO(JOO(jaUUUUUUOUO 


OOOOOQOOOOOOOOOOOOO 
^ r\j  ro'r  m >o  r-  ao  cr  o <\j  cn  >r  “ ' o sj  c\ 

QOOUOO<jnUHHHH-4HHHHH 

ooouooonoooonoooooo 

q.  o.  u.  o.  u.  u.  q.  u.  a.  Q.  u.  o.  cx.  a.  o.  o.  o.  a.  a. 


♦ 

UJ 

•* 

X 

— 

—3 

h— 

— o 

4— 

in^n 

U5 

— * 

•*  «. 

— 4 

U- 

h~ 

z 

-IvC 

ro 

— 

LL  UJ 

•• 

II  II 

O 

* 

LUO 

1-4 

— * 

-3“3 

O 

w— 4 

CO 

CL 

II 

•“  *> 

m 

Q-r\j 

CO 

o 

a. 

-3 

*■— » 

•» 

II 

•» 

-3-3  CO 

>u 

— 

+ o 

♦ 

UJ 

4—4— 

<—• 

f— 

o 

— * 

UJ 

“3 

LL  LL  LJ 

UJ 

— 

f- 

— *— 4 

V— 

•— * 

Qw 

1— 

LL 

"5-4 

< 

a.i— 

H—  O. 

-3-3  J 

— 

Z wO 

oz- 

2^LL 

— 1- 

1-0 

a.  w 

— *V-0 

a:  - 

21L 

OZ-) 

X ZLLLU 

X“3oO 

zo^ 

•o 

tuo 

3rn 

»LU 

•»w 

X o »uc 

21^.20 

iXo: 

-iO- 

4|X 

•— » 

—4 

4CW-* 

O + — j£U. 

► **LLJO 

••U.  ►N 

ULXJ"^ 

x,  o 

•^Psl  -^lP. 

— OJ— « 

m 

i-O'J' 

• — 4£-£UJ 

— «— « OJL(J 

—4  1 1 . iH4N 

OQ.UJ— *0 

oo—o  •* 

^:iry  -i 

— « 

Cvj 

OXf^Z  o 

4— 

U -3 

LLJOO 

XOO 

oooo^:z-«— 

O 

II  II  • 

• II  o 

II  + -3  II  II  ||  f-* 

II  U H - 

^ 2-j4-4rn 

co  rc\  4-4  —4 »— » 

• p— 4 0 

CT) 

UJ 

"v  H 0.1— 

Hr  %>U 

Q. 

•— »VMJUU  • +■ 

•*  •*  t • LJ 

1 UJ 

»• 

— Cy-iOO  T “3 

1—  *-!*-« 

^UJnO 

vO  vUCJIUJ  u 

O 1 hJ 

>u 

“*3  • O ^-4-3  -HU  • 112 

m^x  o^r*>o  o wctnw  •aooguni  oc 

^U.i  II  II  II  ^ M CVJ  M llU.HU.-)h  ^\i 

UJW  II  ^ II  UJ  UJ—''  II  II  if—  c 

OujU.jC./V^.  U.  V-J  ^,LJ^.*£LJLJ0i±.O  v-l  O^UJ* 

o o •-•  a.  a.  ^ w-*  uj  o ^ lj  a.  ^ o cj  o »-•  o o lj  lj  cj  u.  cl  <- 
m 'O  r-uj  v .no  •■4  i>i<rn> 

— ■«•— 1 —I*—'  — M\J  C\J  ‘M'MIVJ 


Of-  ^ CJ  • UJ  QL  UJ  UJ  • • X^UJUIUJUL 
UL  UJa.Zt-->|—  « II  i-jif-Or-CJ 

UJ  <*.  *l.  w *-*r—  •-«.-»  — w^— *— «^-*— •»— 

•"-U'i.UUJCtUL.U.U.^l^U.a.XUJULUJ 
u^ugMjtof  ^ 4-^»—»  g ul.  ^ ry 


BEST  AVAILABLE  COPY 


UOOOOOOO^OUUOOOOUOOUOOUOOOOUOOUOOOOUOOUOOOOOOO'JO 

o— *<\jm'Tm'Of*-a3oo*-*(\jm>rin'Ur»aoLrmrH<\jm>}'m  vor*ao(7'0*'J04m'Tmvoi^u;o\o— irgm  >rm  >or^ 
c \j  (M  rsj  (\i  eg  cm  rg  eg  i \j  cm  rn  n ^ m '■n  m (t  > o ) m m i ^ >r  >r  >r 'T  *r  'T  itn  irurun  u urun  in -o  so  o o 'O  >0 

OOOOOOOOO  'iOQOOnoOQOOOOUOOOOUOOUOOOOOOOUOOCOOOOUO 

cl  a.  a.  o.  a.  a.  a.  o.  o.  a.  o.  a.  u.  ql  o.  a.  o.  a.  u.  a.  a.  u.  a.  o.  o.  a.  u.  o.  a.  a.  a.  a.  o.  a.  u.  o.  u.  o.  u.  a.  o.  u.  q.  u.  a.  o.  u. 


vu**-— 

•o<j 

<\J  • • «—— 

— «c\j(N 

LU  < • •«— 
►OJUJOJCMsU 
• ► »»HH  | 

m • UJUjrNJ 
II  •*  * 

II  II  • - LU 


II  II  - 


•— *f\jrg  *■  •*" 

•»  •»  *4“ 

• •* 

<-L  "'L  • 

• • Q_  CL  w 

► - Q. 


U_  • 

Cl 

CO 

«■» 

•> 

1AO 

UJ*-1 

— O 

“5 

cno 

-U 

— » 

— • 

mo 

— 

K-CO 

Z. 

z: 

Z. 

^ •» 

UJ 

•» 

•» 

•» 

» •* 

— 

•» 

► 

•k 

— 1^0 

X 

X 

X 

— *v0 

m 

X 

X 

X 

-J<1 

X 

21 

2. 

— ♦LT' 

o 

X 

X 

X 

hO' 

ZH 

II 

II 

II 

II  II 

o 

II 

II 

II 

H II 

CJLO 

•> 

"5 

—> 

-5-5 

m 

~p 

"5-5 

•» 

•» 

► »in 

•» 

•* 

* •> 

>u-. 

— » 

««  — < 

>o 

A 

— 

— * 

UU' 

"5 

“5 

-5-5 

W — * 

“5 

“5 

“5-5^ 

1 — 

W 

UJ  ^ 

nT  ^ 

w 

WWQC. 

^ULI 

LL 

CL 

LL 

CL  LL  ►— 

►—  f-4W 

— • CL 

LL 

LL 

LLCL 

IUUJ 

•» 

•» 

•»  •» 

Mua 

•> 

•» 

•* 

•* 

a:  cd 

*5 

"J 

ac  •*  * 

rn  “5 

-5 

“5-5UJ 

0£X 

:33' 

V 'T'tKX— ' XXX«-«-» 

5—^  ► ^vTXX  ^^nTXXX 

u)CO  >0  O •*  •■rn'T^  •“  •*  •>>T'4*'T 

cc.**  • •'U * •*'**<— vy  -o *u  •*•*•* 

•— i •*  cnj c\j  • »'Uhjnn  • • *gj  gj 'U 

ll. • ^r-<i\i<rg  • • >u'^cmcm*m  • • • 

co  lulu— *•— 4rvjrg  •■u— ^^^cnjcnjoj 

UJ*— * •*  »UJUJUJ— « — 

-U  • • • *»JJUJ  — i<N  * •*  •HJJU.IUJ 

h— GO  - - •*  **UJ  — i «■  • - ► *•  ► 

uj  ||  it  • • »*UJ  • • - 

>h-  II  II  - •*  II  II  II 

_J<1  II  II  - II  II  || 

Zh-  II 


o — »Q-  o.  cl  Q-  a.  Q-  < a.  a.  a.  a.  a.  a. 

• UJ*  • • • • • » • • • • 


U\OI 

H) 

m>ro<n 

— *tn 

UY 

ai 

•u  CNJ 

<r 

ooo  * 

ZO  — 1 

CM 

m 

>r 

UOOlXIU^sTX^X^i 

— .o 

o 

OOOZZh-^O 

-*^o 

o 

o 

OQO^Oh  •»  *•  •— < •*— * » 

+ mm 

m 

m 

• rMm 

+ "5^ 

m 

m 

mm*-jm— * xxx^x^—x 

* 

•* 

•> 

»>  *uj 

| UJ  •* 

* 

* 

*> 

* * # x* '*»-**■* •* 

X | «o 

o 

nU 

vOg;uj*j 

e;  i no 

x 1 v(j 

>o 

O 

*-  • '-'ZI  — 2 UJ^ ►-*-»— I— f—l~ 1— h- 

2LU'XLUUlfcU(XlJjLU  • XZUJa  Z LU  CL  UJ  CL  LU  UL  LU  LU  *UJ  <0  <<l<  < < < < < < <X  < <1<  < < 

it  ^i— -;^->i- ii  ti  azkj  ii 

■— *'—1  wwi-nr-  *r— •— »ut.r- Lfc.uLQLU.ci.uLULia.ci.  JLu.cua.iX.uE.uLLj 

AccLLUJCLUJ'tUJU.a:u.^.XU.U.a.UJA.a.(XUJU.|JjauJlLU.U.QlU  UUI  U JUI  JLJ1  Jl  ILJtJUULJLJLJ./' 
i— »JKQL_«CX_*UL^^'— •JtOLJL‘-*^(X-*CX^Lr._*5*— i_*U_-CLLLLLU_U_U_LLU-U.LLLLLL^-LLLLLLU_UJ 


>j*  m r*  uj 


<m  m >r  u) 


lj  o^ivji'isru'g^imninioimuun-* 

O OLJLJf 

— < ouuoouououuoauc^ 
m mmmmmmmmmmmmmmmm 


REST  available  copy 


365 


wr 


ono'joouoououoouoouoooounouoouoouoouoooouoouoouoo 
^ cnj  n > >r  in  >o  oo  cj' c\i  rn  in  >0 co  o ^ f\j  m >r  in  >o  r- go  O' o r-<  (M  ro  >r  ir\  'O  ^ oo  0s  o ^ (\j  r»  > >r  'O  r- go 
o o o o o o vj  o o *-*  ^ ** —•  —4  »-h  —4  nj  r\4  rg  csj  c\i  cm  cm  cnj  eg  rvj  m cc\  m rn  on  m rn  m co  >r  >r  >r  •r  >r  >r  >r 

OOOOOOOOOOOOOOOOOOOOOOOOOOOO^OOl^OOOOOOOOOOC^OOOOO 

< <1  ^ < <*<  <.  <1  <*  < o.  < <i  <i<  <1  <i<  <i<x  < <1  <1  < <i<  <1  *0.  < <.  <1  < <a  <1  <r  <1  < < <1  <x  <i<  <1  < ^ < 


U>— % 

CL  CJ 
LU—4 

OCNJ 

2U> 

<4.r- 

co 

— 1^. 
<0.  •» 

*— • GO 


UJUJ 

XP" 

H-< 

00 u; 

►— 

2 •*  GO 


cro 

u.— 4 


07 


^.O 
•Q.*-  *- 

Ln  • 

ooz  uj 

LU  •*  P— 
• <1 
<0  h- 

JO^ 

-JwU- 

<UUJU. 

(ji-a^ 
U1LJ  •“ 
LU  ^ C\J 

<:  - -4i 


x 

Li-  i. 

JJ  •* 

ljx: 

OU3I 


UOCS-  3 

U-— i **U- 
IX  •'UJU 

— ► 2<N*-2 

*0 <1  •* 

0000  •*p—a.v>oou- 

^jrr -41-2: 2 2 u 

<A  a)«W)WN\N\ 

UJGO 

2 ZZJJJJJJUOU 
— 1 'VirjcJCDOjajcQ  JJQJ  C\l<-> 


CL 

CL 


— nT 
CL  >H 


2 
co- 
ca—4 


a. 

1 

u 


-o 

4:  • 


U_  + Q-i-LJ 

— u>  o 

II  -4  II  l|  -4  II  ^ II  CL-J  (I  _t  II  — II  — * II  * CXI-  II  II 
* — ^U\U1 


+ 

o- 


Q I 
2 


<J>X 


a •* 
2*1 


-QC  in  «f — + — +—Q.  + — + — !-■&■►-«— 

OI^)ZZ^4lZ.ZUJ  II  ~3  -5Z  “3  -3-fr  “3  “3  l|  II  -3 m HXOO 

LJh-22ULJLJOCJLJO  II  -4— * O 

it  aiUJI.ZtZiiujh*  -4  U--4  a.  u.  u-  a_  a.  u.^u.11  II  — «u-  11  11  11  cnj 

OJ  AtiiXiti.1- j»m  11  II  UJ  II  1X1  It  LU  II  It  UJ  It  uj  II  'I  uj  11  xa.u  UJ 

— -LJV— 'LJ-C.'— 'l~J  W l — > LJ  uj  LJ  LJ  LJ  -J  LJLJP—  ^XUlJ^KMAU 

•yip—  uuuuuu'-' “3i-io ~jlj  iuu  -ju  luu^uTj^-itzuotii 

2 

uj  o ^ 

2.  ^4  ^ 

X 

a 

o 


CNJCX  ■— I 

+ JU  -f  'J>  II 
-t  I— 

AJC/)  Xl/)^ 

i-2  11  3L2 

O' 

II  II  _J  II  11—4 
IX 

xttxtu 


BEST  AVAILABLE  COPY 


366 


ouoouoooouooooouoounouooooooouoouooooonoooaaoooo 
o ^ osj  n i m >o  Co  cr  o ^ fN  rn  >r  in  <3  od  o —4  c\j  m in  r*  ao  o' o rsj  vn  co  tj' o ^-4  ro  >r  itn 
>ru^inu^u^mu‘'inininmNO'4j'0'0^'U'0'0'0'Wr*“^*r%*r— r-p^'^»r,,»r*-r^a3oocoooooGOoocoooco(j'i/>u>(7'ij'i/'0' 
OOOOOOOOOOOOOOOOOOUOOCJOrJOOOOOOOyuOUOOOOOOOOOOOOO 


[ ^ < <3.  < <3^  < ■<  <X  <<■  <<  ^ 


a. 

2 


OJ 

cO 

>— 4 

I— 

-y 

< 

G- 

rsj 

h- 

>r 

l/l 

+ 

</> 

fj 

•— « 

CL 

CL 

2 un 

a 

0 

a. 

O 

“3-* 

CO 

CO 

Q.  -« 

cO 

CO 

o 

rn  ►— 

>r 

— • •►CO 

«► 

f“~4 

* a 

+ 

0 

♦ 

►— 

X. 

r~ 

h- 

O 

u 

0 

CJ 

•** 

— * 

*— 4 

H- 

1—  XU. 

“3 

1— 

“3 

“3  O 

“3 

O 

“3 

(NJ  Q — + 

2 

<UJ 

*w 

W 

w 0 

O 

O 

2: 

•» 

~ 0002a 

LL 

Q 

U- 

CL 

UL 

a. 

—a.  2: 

- — » 31 

*•-4 

•JJ 

O'OUJ 

Ill  — • 

•JJ 

_ 

uii  U 

X. 

•*  CJ 

-*  — »—•  * O 

u. 

— * UJ 

LJ 

zu 

LJ  CJi/j 

U 

* — »i  i — • 

i ^ r-  1 — • 

OJWi—  •*  ►—  || 

O 

*~O.LJ 

LJ 

LJ 

• O.LJ 

•JJ 

cO  \ 

O 11  tn  \ 

10 

>-20  < 

1^ 

•JJQ. 

a 

11  1—  2 h-  H--«  + 

2 II 

— CL  • XH-— rfj  || 

*-4  • I 

II 

11  nJ-  .j*  11  — «m 

1 II  ' 

HVI 

*3VM/I 

— w 1/71/1 

r—  ■*■ 

<-# 

'T 

•u 

• 

1 

u ^ 2 1 0 to 

a-x  + </^>_ix>-^</>  + 

-►  UJQ. 

^ iH 

— t JDU.+ 

—* 

+ 3 

L-4.«. 

►— 

'UUJ 

0 •— «o  2 

*— < *_  • y 

-3 

•</3“> 

“3  ZQ.U 

“3 

a.  co  “3 

e ii 

Xt—  II  II  -)<X)Z  II  -<X  II  II  “>  II 

0 11  -t-5  is)  11  11  — —> 

“31/) 

w-j^o2“3 

w 

“3CJ 

w1 

<1 

*-*»-*  11 

II  fl  —»  U. 

u- 

— « II 

LLP— 

u-  p—2  II 

U. 

2 

II  U. 

II  r— 

II  rh-f-  l( 

11 1—  »*  t— »—  i»  x 

II  1/) 

II  wx.r— uj  11 

UJ 

II  — * 

OJ 

uui  11  2^  M cu 

II  w 

CU 

VIVJUJ 

u UJU  I/)A/;  <iw; 

2U; 

«/>u.u.<4i/n_; 

L.J 

u~a.LJi_ji_j  uu-u. 

LJ 

U. 

U.LJ 

A-*5ll  -JCJ  “iJtL-l-t. 


II 

2X.-Ji_2~3cc.LJ  2 X.CJ  3u  3*'-‘V/)\*JLJLJ  >LJ  3 LJ  3«VJU") 

*■*  o » >r  vr 

«— 4 ^ —4 

-•  o 


BBT  AVAILABLE  COPY 


367 


368 


BEST  AVAILABLE  COPY 


APPENDIX 


o 

O' 

o 

o 


—• 

o 

>r 

0 U 

i— 

o 

'T 

<✓) 

r— 

oo 

o— 

2 

UJ 

c\j 

HO 

2 

rsi 

wrn 

LL 

fN'— 

C 

LL 

2 

LL 

lj  muj 

LJ 

<x 

UJ 

i"Uh 

2 

LL. 

LJ 

v//r 

LJ 

2 

o 

o 

2^11— 

*— « 

LJ 

LJ 

*2U) 

LO 

*— • 

O. 

— * •**— • 

2 

u> 

Q. 

00 

o— * - 

UJ 

2 

>*■ 

H>ff- 

2: 

UJ 

C/> 

00 

w^4(n 

►— « 

31 

UJ 

(N 

^>rv-* 

o 

•-H 

«• 

CL 

f\J 

0^-2 

LJ 

X. 

<* 

l—O  - 

ii 

x* 

N— 

X 

wth-a 

II 

ni 

UJ 

2u)2 

rv» 

*-4 

U_ 

CJ 

-_J  •■ 

O' 

ooo 

U 

2 

— »Q. 

H-l 

h— t— t— 

• 

•— -^C0-“JL 

i/)t/0v/>O 

o 

•o  — * cn  2 

21 

2*-J 

Cd 

2 

— • — C\4  •* 

UJ 

HH 

o 

LLlLLLLL 

CD 

00 


c\jcg»—'—  u. 

O'— <>T2 


□oo  o 


T r\J 
102 


*-h 

>TLUI— O - 

X 

2222 

3. 

z - 

-J 

— . ♦ — t — . — ' 

UJ 

LJ  U C J LJ 

► 

2<1  -500U. 

LJ 

►— < ►— « ►— « »— « 

Osj 

22 

QQL  -22 

2 

uo^c O'/) 

432 

UJ  •> 

o - 

— ' 

2222 

U - 

JQ. 

2—^00— *2 

•» 

jj 

umjuiui 

UL^-4 

COO. 

Ul 

h— 

2.L2.2.CU 

*u-  2 

CX.LJ2 

— > ~^f\JC\J 

}— 

2^f\ICO>r  <L  UJ  <5. 

Hm^mQ 

2 - 

UJQC  - 

O (NJLLI  •nzu.  < 

QOOOOOOhHU. 

QQOQCC 

-Q» 

►—CL  CL 

Osl  — K— ^ — UJ  ►— 

Ul—  ►— ■ f—  f—  h-  K—  CO  < — J 

Q. 

HQ. 

— - X 

0<.<XO— ‘CoO 

2 to  oo  U)  00  (/)  oo  -5  QL  «A 

CO 

II  II  II  U 2 

2 

‘Tihr  202 

Q.\Z.2ZLJL\\\ 

nJ* 

II 

-*x  — 

^-JWM/)VXX 

'VO'X  XM  NVV/Kl  — l 

co 

>r 

-ini'TU^ 

— 

LJ  — < r— 4 

U.  <A  *-«  id  <1  LLI 

CL2— «<\jmvJ*_j(X”5ii<L— > 

c\l 

llo.Q-1—  — « 

lX  t\J  — 

—4  ^.—4 

-4*0 

Z^Zi'-J-J-J-J-iJ-JJ-J-iJ-U-lUfN  U'  o 

C_;ojcjtJ'XtajX!ajujajcocucoajcuajcuu-i  so  m c_jo<\i  ii  u it 

MMMM\SSS\SNSNNNSNSQ;vJi  ^rr>(M  If  |— 

U)C/-)COU}22222222222222UJ  -L  OK-  COLLI 

^^^ZUuGUUUUUUUUUUUO  II  LL)  II  II  " I—  < -jQ(^ 

UJUJlUUJLAi2:iiAi2.a.i.iiiliJ  LJ 

2 4.  a.  2 2 2 4.4.  2222a.222a.2t—  Ck.v-I'^OI^T  -Ji/mja. 

MMMMUUUUUUUUUUUUuU^UUQ>UaaU,QiU.  •• 

UUUUUUUUUUUUUUUUUU^^^^^^-^^MWf- 

2 


o *-1 LO  LJ  — * UJ  r3  \TN  — 4 

-lOUV^O^-lXH 
Ul  — * •— • »— • i— « <T  — •""*  •» 
►-«  »w  O 

LT\t— aoini— wf- w 
«— » <3.  ^ w <3.  UJ^UJ 
ULr^Uirif- 
■Q.  LX.  <3.  u-  >— « u. »— « 

UJUUUJUOLUU- 

CTLU_QQLU__*LJ»_* 


o 

o 


<NI 

LJ 

o 


OOOO 


369 


best  AVAILABLE  COPY 


LJ  • 'X, 

• 

X.  ||  ^ 

OC  CD  - 

I— 

UJ»— •CO'-') 

tn 

QJ  ►<  1 1 UJ 

<3 

- LJ  *—• 

UJ 

• -*LJ  — J 

— • 

h— 

►CO  _£  —4 

• 

<1 

-X.LU*—  CD 

1 

IT\>  <1 

1 — 

— 

o 

l\J»— 'UJ  OJ 

1 — * 

*— • 

H- « 

NdU.U 

1 3 

► 

► 

culj>-  a. 

— — 

| • 

CM 

CM 

•— 

*-«  »—  a.  — 

a.  cl 

r m 

a 

►UJ  CO 

0-0. 

1 —4 

<1 

<1 

—4 

II  Q.LL.O  UJ 

Z2 

1 UJ 

LL 

LL 

;> 

► ». 

1 ► 

O 

_J 

a* 

LOI — *-♦  *— • 

—4—4 

1 X 

<4. 

<1 

o 

• CCJ-  CL 

II  II 

1 CM 

► 

► 

-J-J^O  LJ 

”3”5 

1 ■— * 

— 

— 

LL  -JUJ  ^ 

► •» 

\ r> 

•— * 

•“ 1 

0<3  2L<  UJ 

► 

— 

► 

OGC^O-iM 

”3-3 

► — 4» 

—4 

*■4 

►■4 

U-CJ^D>v<l  ► 

► ► 

A «.  I 

► 

— 

«► 

CTZT-  • — < 

—♦CM 

CM°U  1 

<M 

< 

CM 

l-H  •>  *-«. 

ww  | 

•X 

LL 

3 

QC  (— XXoOOJ  II 

<< 

CM<  1 

— J 

C 

O 

1- 

ujzin  vO  cox 

uL  U- 

— ►U-  1 

<— * 

— LL 

< 

00 

CClUfM  **CJI— — 

O — 1 

1 

►— . 

3 — 1 

► 

«£ 

2-OON*  ”3 

«3<l 

cl  gj  < r 

Q-<1 

_jujvjlm/>  Qi  ac 

•ww 

o • ► 1 

*— 4 t 

LJ  •* 

— 

LJ 

JL*-«UJC\JL3LJ 

► ► 

►Ol-^  | 

►O) 

►— 

► 

<L 

i CL  ►!—  LL  J- 

— » — 

CM  — 4 »-H  | 

CM  -• 

l Vi  •— 4 

CM 

<3 

r^uj-  < tu^u* 

— UJ  ► 1 

'—UJ 

»— » ► 

— «0C  II  oO 

Q-C. 

UJ  •*— 4 | 

OJ  •* 

UJ  —4 

UJ 

f— ( 

► >•  — ICO 

LJ  LJ 

h-  I 

h-  X 

1— ^ 

h- 

O 

^ UjUJUJf—  LJ 

► ► 

«j.CM<3- 

<3.  CM 

<L 

V— 

^ Z CQ  U ■ ♦ *5 

—4 —4 

ac  wLL 

dw 

ncu. 

CL 

oo 

CNJLJLJ  •— < ► 

II  II 

►CM-JX 

•*nT 

CM  --J 

► 

z 

\ -3>>XoO*-4 

•—4  »—l 

— *m<CM 

— ► 

x-.<t 

— 

• O QC  -TO  LO 

► ► 

ox  ► •• 

*—x 

— **=3  •* 

•—4 

••  *<C,  LL)  LLI  ►COLLJ* 

Q.  CM— • 

►CM 

• -4  CL  — 

► 

L J 

»—c-  o 

►—4  *— 4 

DU  * 

— ♦ ► CO 

ljzto-4 

—4  —4 

—4 

KDU  iflO>-Q. 

► ► 

0>  ►•  ►UJ 

wC»\  ^ 

UJ  ► ► ► 

— 

LO 

< _J  CLUJ  h-  o r\j 

— leg 

-4— 4^(MQ_ 

LL*  ►—  —4 

CO  JOLL—*rM 

uJ  LJ 

z 

CJ— 'CUOLJU- 

— - w 

►—  ► 

na^w 

h- 

UJ 

LJO-V)-5LJU-li-  11 

UJIAJ 

UUJUUJI- 

<-  LJ 

LJ  0-2LUJLU 

<L 

i 

i-Z>oo  OC 

h-  H- 

►~l—  H- 

or  h- 

•—  UJ  ►♦—  ►— 

a lj 

—4  —4 

O*—  I—  UJ— 4Q£  Q. 

<<r 

<rx<x 

•*o 

cca.<r<r 

► 3 

a-a 

a.—*  o ujococ  — cl 

CL  CL 

QOCOCHu 

->L0— »0 

O - XaiQC 

-3 

XLU 

Z U.OUJCQUJUJ  XlZ 

WW-»« 

o < < a. 

•-icDO 

J)  *» 

CL  CL  — 

QC 

~(/)Uclllx.c£~Q  < — i 

— OJ^-'JJO. 

-*o<i 

— X — — — 

a — a —♦ 

— • 

- -j  o.>Dii  — 

— — • 

-CM-  rn»  Z 

<r-  »— -% 

-•'UQHrsirn^  -r  ^c  ll 

o *■ 

►<5.01  - H“  ^IDOCM  wq  + 

CO  00—4  ►— 4 ► ► 

*-H  ►—  r3 

OJ— 4-M— 4— 4__h 

► — 4 — ^ 

ox 

x QCLu  ►-  z:*zz  ►-  • 

00-4 

• HX-1ACM 

-4Xh  • 

4— 4CM  —4  CM  4*  • 

oo 

oui'tax  ► ii  jaa  joou.u*-<in^ui 

4Ln_JC?f\Jh-“-4>v— 4-4^ 

-4—4  -t-  4*  UJ 

-0-4 

'M-Li  0*^  |l  II  ♦ LJOJ'XLL-4,- 40DUJ  ►Ol  ►INJ  II 

►fNJLJLLI  U 1 ►%  ► ► ► 

ll  •MJJ  O 

► V 

-ajvf-ra  *^o  - -— 

• O'- ’>D'- 

i •D'—  iz  • »vo— g;^OsO 

1 O •'-* vO  — 

i-*-z-s^a^a^  oco 

iniTN f— CD ^ h- 1— 

-l-UD 

N-,  II  —♦ 

— I— 

<UI-  si'iz^ZZlI  <»  II 

— <<UJ<UJ< 

— U.<1  < 

H <3  UJ  <3  LU  UJ  LU 

II  II  II  Q.  II  UJ«I 

2,  UJ  ► V.  •*  -J  • 

UU2. 

-1-Xl-ii' 

i-2l-j^ 

*-4  h-  i.  r—  ►—  h- 

CX3  h—  ►—  ►— 

l-i—* 

U.U.XUJX  II  UJ_J  — 

— hhuL— «QL 

II  HU 1 — 

II  *1MV_IUJ  — OJ 

HU.UI 

CL  LJ  u-  a.  u-  u.  LJ  CL  UL  UL  O UL  LJ  ^L  LL  1— <4.  U- <1  LL  LJ  — 1 

CL  U-  CM  ►^ll—l— 1— -L  — 'LJ~^0.*CLLQL  u_ 

* ^lL  J>LL  LJ 

V^LU"' 

Jt  u.  •* 

►if\jn'rzzz 

—4 

UjUJUJ 

o 

CM  Ol 

r-'T 

vO 

OMM 

O 

-*  2-2-2. 

o 

—4 

>— 4 

LJ 

— ill 

o 

»*H  —4 

—4 

o 

-•  O LJ  LJ 

—4 

—4  —« 

—4 

'O 

uuu 


available  copy 


-J 


NPF 


X 

<3.  I 

<T  — ro, 

O — ' O 


co  I co 

2 z 

13 


z 

Z 

LJ 

LJ 

r— « 

—4  + 

•— * CO 

o 

CO 

co  -*<7' 

. m 

<r  z 

— — * I -jm 

LJ*— 4 

OO 

LU 

CAj  ^ 

LU  h- 

— 4 w O — « 

LJ  i. 

<L  * LJ 

COLJ 

— 1— 

•HJJ  r- 

h—  — • 

- q_  *— 4<\j  r y- 

— • — Ih- 

CL  CJ 

2cH-  1 

— Q 

-'-‘V  I ^ 

Q CL 

2:  h- 

'-C  o 

* OSIlU 

2<\J  1 H-CNJO 

21  LU  — O 

2T 

ah-  o — 

+ OX. 

— *0 

Od  «0 

1 

a co  x 

Z2. 

o i z:  •■m 

— - aj 

— <oa  a 

•*-— • —-42: 

•-H  ► 

*£.-4  •*— J + * — 

i\i  •»  <i  — » 

Z CL  *"*  •» 

—4  •*  iUX 

►-•z  — iz— > i. 

ox  *—o 

•*  II  II  -H.C  —4 

II  II  <3.  -f-  '—'—4—4 

I ♦ *uo 

H^ww^-4  • 

OO  »HO 

o s: 

2 rn 

w^LUsU—* 

l^OO^UJ 

vU^4  t— 111 

■—•  O II  — >— * -4-  — ' —4  II 

— »— — * *XO  1 ♦ 

u.  il  o LJ 

t-  OJXZ#  -*cj 

► ^UJ*— ’^L  II  II 

^LUCJ  — LJ 

iOU^NtUAr- 

a.  —«•*  • >uw  — < 

<<*—->■«■  • 

9 

X II^^U'Zh-+»H 

— *Z*-»cl  vT— »— 

*-»»—  Z*-« CO  LULL- 

II  II  <LJ  LU  UJ  31  CO 

UJUJV*  • Z-J— 1 

1 i.0LOl<l  It 

'-^Q.MaJ<«  <X  V— UJ 

i.  CL(\J*~t— LJ  —1—10 

")HKiOX  ll 

II  r\j_j  — t-  3_  — 

II  II  ||  H •“» 

rif--i-,<uja 

II  LJ  •— 4 <1  <3. 1 — II  VM 

«a<  r—  i.  ii  il  M 

II  — J II  '■^•—•CLU  VQJ 

il  II  ^ 

UJ*— *10.^1— V— » 

u.»— • 

II  h“  r— 4—  II  ll 

ii  r— i—  ii 

-*-CJ<3.  lj>  ULLJ>-'<1 

^OJ  —J  _J  U.<J.Ll.CJLJ<*CU'-Ors*CJl-J 

JCSZLJ^H/lLJ.^:  CJ 

V//U)  LJU- -»V'-IIM 

2 UJ  CJ  •*— ' 

X.  2L.  X X.  a.  JL  — * 

* *-4  -5  *-  O *-4  4-4  i.  -1  — 1 

— • »M  — 1 

>T 

rvju  t 

t\|  HI 

CJ  u\ 

o 

cj 

— * IN* 

> \J  'M 

o o 

o >o 


u*-* 

•» 

X Z + 

l-< 

:d 

< LJ 

zx 

CL 

X 

•> 

O 

1— 

-12: 

2: 

1 » -4  * 

*o 

II 

W 

-y)c\i 

(M 

>— * 

0 

^ zr— 

*nO 

*U 

z 

— * 

<UJ 

LJ 

— »(>J 

—4 

^-4 

-C  QCf- 

h- 

*— « 

m 

1 

X 

LL 

•*  h-< 

0 

z 

— * CL 

LJ 

UJ< 

a co 

1 

w LL  * 

O 

t— 

r— 

—4 

0-5 

LU 

O — -LJ— • 

<lo: 

u 

*"• 

i— r- 

^ —4  — 4-»  — 4 — 

— 

h-u 

LJh— 

O 

►UJ 

<1  r- 1 

— » —4  — 4’UQ.  ^) 

r— 

<N 

<y>a: 

O 

•— # 

2;^ 

CL 

H* 

X 1 1 ~*-zcl 

C 

• 

—a: 

O 

LJ 

Z 

000 

+ c\j<^0 

V— 

LU 

wUJ 

— * O — ‘ ‘ Z Q- 

QH 

w 

^h#H* 

♦ — » O CL  LU  - 

ZZ 

_ 

CL 

w a. 

O 1/7 

LU— 4 

—4 

X^Xh  1 — Osj 

» 

•*  # — 4 — 4 

*> 

LJ^  1 

+ -« 

21*-« 

1—  ^'-*-4 

zrNjrgz  + O 

rsi 

-J*-* 

t“Z 

0 — — « •* 

<3.  •" 

•» 

•*  Ll) 

U. 

5L«-m  II  II 

CJO 

^ • — )(_D^—  •— 4 5L  —4 

II  II 

« ll  ll 

-HX  II 

II  -J— « 

— nogw—^onn* 

Z. 

lj— « 

►“*LLJQ-*-*oO  Mt 

CO 

X 

fMOOmm 

ii  lu^—  >r^co  *uuq2  ■ 

f P—  *— !•—•(’«  ^U_»  *4.^1 

•—  <^<ND  U*-  — UO  115 

—J  h-UJUJ  •*— • If  II  ► 

vOCOh-  h-0'~,UJ<CJ^U  Q- 

II  rNj*-*<J.<u—  ►—  f—  ^c_ t—  LJ  I 

w^-r—  *— *u-  —■wu-  •— *r— 

-iUU.U)vfuwC£UUU.a.uU^J 

AJ  — LJ 

<>J  O «•»  f 

o 

**■ 


+ — II  »-MI * 4.  ——  o O OhhOOD  a-  II 

LJh-  "5-JO  •—'*-4  t(  —•*—*<-  | • (\)*— CO'')!—  .’•LJ  II  ft 

Xh-  U*-*  | w w— « | *-*»^*— *-h  •—•■«— w*—*  ►—  — ivT^J^TifoOCO  — J — ■ ►-* 

— coh-  ujujn  uioiZ  luiu*.— iOf> «*-*  Z 2T  *c  <D—  rJ 

5£2IC>J“5I—  Hi.ZOhh  I—  • II  O II  II  V__-><1  -JOcO 

II  PI  <1  <3.  11  — *<1<  II  II  «J  11  II  I—  II  II  II  (XI  >T 

II  II  it  r— »—  If  ll  r—  r-  r— r—  w ^ X^.  >v\i  II 

jc.  lj  Vi'S)  [mjss)s/i*mKmj''tu)— lj 

*-»x  >lj  — »x.xa.LjaLX»-*xa.i-i-j'"^XLJ 


BEST  AVAILABLE  COPY 


Z. 

•*  ^ 
-«  LJ 
II  — • 

— • f— 
•»  < 
— • o 

— • L# 


O 

u. 

LJ 


CM 

4* 

CM 


O 

O 


< LJ 
F-  — 2Z 
U)vT  <1 

—4  ►— 4 __J 

^LJ<1 

►"JUJ 

UJ  •• 

F—  XU- 

<3.  UALJ 

F—  •* 
OOUTUU 
Z*-»Q 
— »•>— » 
F— - 0O 

< 

QLUJU 
• <1  <1 


<3. 

cc 

UJ 


CL 

UJ 

UL 

X 

a 

cc 


LJ 


CL 


X 

qh  -L 

F— 

<1 

— * 

w 

i/> 

—4 

h- 

LA 

CM 

UJ 

— - F— 

CO 

-J 

• 

r- 

F— 

A **X 

Z 

*— « 

m 

t — ) CNJ 

< 

-■XO 

< 

4- 

<r 

o 

F- 

tX 

1 

UJ 

F— 

uO 

— • •‘CC 

F— 

— 

— 

— 

LJ 

OLJ 

*—4 

o 

—4 

1— 

• 1— 

— 'LJ 

W 

-O  •IL 

>- 

»— • 00 

— » CL 

•» 

CL  O' 

y> 

~o 

zo 

UJ 

wH)Q 

incG 

t— • -J- 

CM 

Z'T 

nT 

u 

-*  o 

1 

1— 

UJ  —1 

A 

z 

+ w 

W 

— * 

o 

■fr  LJ 

CM*—  — 

< 

I-IL2 

UJ 

LJ  A 

—•UJ 

LL. 

ujo 

— • 

o 

o 

NT  ••VA0CQ1 

•— « *»< J 

OF- 

ii  ►— *-«>r 

— »F— 

F— 

F—  F“ 

A 

F— 

— » 

—4  — * • 

0C-  *-4 

CM^f—  <X 

(A 

UJ<1 

<1 

<3 

UJ 

<r 

o 

— OCM 

x.  o + 

♦ 

F— 

3 0 0 

F— F— 

QC 

F-O 

F- 

ro 

• 

•—-4  • 

o—  . 

'•  < 

II  II  QoO 

^ OGH 

<J(A 

♦ 

lOO 

< 

CJ 

—4 

o 

3 

— CJ 

H- UJF-F-F— 

— ujo: 

o 

F— 

CMF-  — 

— * 

CMF- 

F— 

LJ 

UJ— UJ 

F--J<X< 

r~m4\ — UJ 

“>“5  F- 

— • o 

iduO 

— J 

— 

^ i/) 

v/> 

II 

• 

• -Z  • 

o«  «a:<x 

—z 

0.00.00 

« II 

a. 

II  u. 

•»— • 

uo 

CL 

— * 

<1  | — 

OF—  'U->> 

LJULLLJ 

— — *QJLU 

i iia-LJ 

o 

>— 

VJJV/i 

X. 

M 

r— 

U)-«- 

ii— * 

lU-  O + 

— icm  •«: 

I'*'  • — • 

X II 

■— 

— • •— 4^.  II 

»— • 

• < 

w 

oO  — 

CJLJ 

• •» 

2^:ujch  ujuj— 3— i 

pj 

UJ 

— 4tU 

— o 

— » 

UJ 

LLi — < 

*— * r N4UJ  *-*  X '*•’  CJ 

i-xzh 

• ‘-in 

OF—  -JCM^ 

II  -^u. 

F— 

CL-»4- 

II  — 

•4 

o 

-1  F 

r- 

•UJ  • II 

ll  LLJ<UA— 

Lluj  »lJ  ^ 

• <i  • • • | 

<1^ 

z • 

— -4*-H 

•JL 

• 

1—4  • 

< + 

+ <1<I  + u-|—  CJ 

3K-OK 

c'oa 

OF—  3Ujuj 

— 4 — ^ 

H-vO 

O O^— •'-^u  \ 

U'O 

LJUO-J 

F— 

U_F— 

o<x— «f— f— 2^f— lu^ 

• • Q.  o — >Q.  00  U.  2 —1 -J 

ujuj  — io 

aja.y 

UJ 

-J 

Q-  X 

• £*:*  <Z<>-*CL<.  CD  0-<CMLJF-  0*-«0  • • >Tl-H  “3UKO  r^F— 0<M  •U-“5  »OLJ 
• <i  — • -}  (X  UL  QC  t~~ 2_  II  _j— J ^ II  _J  II  >T<1<1  II  f—  <3.  X ii  >T<IF—  1 ~?t—  ll 

W II  II  ww  i*  w ||  w_>^4^u.  II  vww  W II  — ^-*W  I—  r—  II  r— F—  ll  ^ II  ^ ^ 

LL.  U.4JL  U.  IL-’,WU^U'*-J  LL  U_  LL.  ••  _JU-  U.U.  VL.  iNiCJU)V/IJL  V ; LL.  — • LJ  OF  LJ  UL  ••  U_  LJLL.  — J 

—•  ”7— 'UCt-t  LJLJ  O'-*  U-F—X  JC— •X  — »XLJ~5  i.  UC  CF  X LJ  ~>0  X »-«F—  ZL*-*^—**. 


z 

z 

Z. 

CM 

CM 

IM  UUU 

UJ 

%$*u\ 

4J 

I**  uu  UJ  O' 

O— • 

>r 

<r 

NT  -<X 

21 

^r>r 

>T 

<r  'T  nt 

CX\U\ 

—4 

CM 

-I 

k. 

->o 

O 

LJ 

o o 

LJ 

LJ 

BEST  AVAILABLE  COPY 


373 


<1 

cL 

UJ 


CL 


UJ 

CL 


IX 

lj 


m 

3: 

o 

LH 

o 

nO 

a: 

LJ 

u. 

o 

H- 

t— 

z 

LJ 

u 

LJ 

LJ 

o 

IM 

H- 

f^» 

— 

*— « 

oO 

o *-« 

cx 

C 

• 

o 

z 

>U 

— * 

2: 

b~ 

1— 

in 

< 

1 

o 

• 

LJ 

cX 

O 

Q. 

»— 

a 

♦ 

• 

o 

— 

»— 

>—  — 

O 

-j 

X 

h- 

H 

» 

# 

— j 

* 

— 

>- 

LJ  u. 

CU  (M 

u 

— CL 

lT\  _J 

— * 

JO 

| 

X3CNJ 

O Z 

in 

Q- 

— z 

J^z 

H 

ZO 

r- 

UJ 

U 

»»lw 

+ 

— 

— ►— « 

UJ 

— UJ 

LJ  1 h- 

z 

a’jj 

LJUJ 

”3 

UJ-* 

— J ' 

h-t-JP- 

'O  1- 

1—  <1 

t 

2H 

h- r— 

— 

1-0 

Z UJ 

<lt— OA 

UJ  • 

-JUL 

CL 

wd 

< 

• 

<J.  • 

— *- 

b- 

1—  ui  *— 

o z-* 

a 

UJI— 

Uh 

— 

CX 

— 

H-UJ 

IXl  <3 

J)fJO 

<_J  LO 

-<LJ  — • — 

• 

i— on 

o*/) 

Z 

a 

Z 

LO— J 

1-  rsih- 

OH- 

• — 

II 

— i 

<*-« 

— Z 

• 

• 

C\|  1 

— • 

<1  Z‘^> 

h- 

lO— 

+ -*  II  2 - 

• 

pg  h- 

— » 

-1 

cx 

_i 

— «. 

V—  »■> 1 1 

Z^C-i 

*-*  — • )| 

cx  -jog 

►- 

yi  ii 

«— « M It 

X 

2. 

II  Z 

ti  — J 

V/J  — « 

UJXJLJ  •* 

CX  u> 

(M2  2 II  X^ 

LJ 

II  UI*-» 

LX 

•» 

• 

* 

id 

— • — z II 

CL  • — 

II  Zl-U  — 

-J  * <1 

• 

»— 4 LJ  •«— *. 

Z 

r— 

CXUJ  — 

wO.^ 

►—  ——4— ►—a. 

— l^OH 

•JD 

w 

LD 

O'-* 

-Jill 

1 + II  — 

3 -JO  II 

— -UJ  Cl  x. 

i -j  o 3 pg  — j 

3 1 *— <UJ  CX 

aj  • 

zujn-Zr— 

mOu  • • 

p-Z 

• »-f  x »<*r-  «♦* 

Z CUXJ  *Z 

-J— »*-* 

HsOD 

JD"' — <r\ 

OliJM 

»N3  LU  w 3-M-0  3 

O'— 

• uuujrg< 

cx 

uj  <X 

uj 

LJ*— * -J 

UJt— UUJ 

mza  _)_jujlu_) 

w 

UJZ  LJ  — UJ-JO 

-ji — i— 

OC  U LJ  <N  h-  CX  C H-  (✓> 

>fHOKO  *01— ooh-i-rg 

LJ"?  • i-  *zu#  pgi-  u^cjh- 

Z<<*  II 

►-Z 

<1 

1— II 

II  II  UXX.H- 

Z— im<X  — <1 

"HZ  TII^I  1-2. 

mu-  z^  « i* 

whH 

II 

II  h-  II 

1— — 

1— 

1— — * ►—  II 

m w r— ^ li 

w 

II  r—  W pm 

a-  u)u;2. 

UU. 

(/) 

LJ  <J  ) U-  Pg  3 — LJ  V » LJ 

••  LX  LX  UJV/JU.  ••  u; 

xuu.  u ;u;  uu  lJ 

u_ 

ILJ  ”U.O0iMi 

— 002.0L.LJ— ZO  JLLJO  — ZZ  ZLJOLJI—  — •“•C-JO— r—  — “3Z2- 

z 

z 

Z 

m 

'T 

ujun 

>*jr»uj 

30 

LT 

UJO 

U 1 

J> 

u> 

XU) 

U>U\4 

1X1 

in 

2-  X> 

J. 

2: 

2. 

LJ 

LJ 

U 

o 

O 

o 

best  avaiiable  copy 


NT  C T 


O' 

— • 

3 

CD  CQ 

Q- 

U1 

G g u 

G 

h- 

•» 

O G — 

'T  2T 

O 1 

♦-  i a 

i"  O 

F— 

u_o 

UJ 

•— « 

— * 

a guj  f— 

h- 

U nTI— 

#-4 

_J 

<vjg  j 

G GU~< 

^<1 

f-  r^<3. 

+ 

1^0* 

jo  a: 

C\J  U. 

X 3 

H *— « 

*-* 

*— * 

— • 

— > — r>g  • > o 

-J  + * 

UGOG 

>0  0. 

UJ 

LJ-^UJ 

J 

in^f-4u-^ui»-,asr^'0 

G | — 

GUF—  UJ 

-2.  uj 

F— 

»— Gl— 

• UJ  w _JLJsO  +■— * 

— * 

G 

vT  f-o 

< 

• <1 

w 

o ♦ ox  • v ->o 

z*:  i 

— IGQUJ 

>04-  <*- 

1— 

Ouji- 

UJ 

• GLU— *0^(NJ^O 

O J 

O.ZJU 

•*  C\jF— 

(✓} 

O-JoO 

►- 

HU.ll.OClL  in  •*!— 

F-  II  II  X. 

O 2 

II 

*— H 

< 

_JUJUJ«ZZUJ  II  *g> 

•» 

2 II 

^Q.H  ►MO 

H- 

• GG  »MO  'OI^U 

US. 

• HJ 

G^£  — * 

2- 

II 

H J II 

v/; 

'OUUH^U^'T  G 

G 

F-«~  »<l 

— II  — * 

— *Q.  ^ 

* NNUQ.NU. 

II  <1 

UUJUJSJ 

IQ.  UJ  sO 

— * 

— * 

* ZZ  »DZUi^^ 

— ►^U. 

•HZ 

1 >—  II  - — • 

G 

-J 

1 »UJ  J 

1 1 

O ii^^Ooj>r-5J.cN^-jrvjiJ 

UJ<X  •♦— 

1 <1  ~l— 

• 

l nx 

UJH-it 

°SJ 

u>  • II  II  UJGXG  • 

• — J 1 • • <h-f— f—  _j^, 

ID*— *►-—•  — J 

ol 

'O'— 

— i_J<  — 

—•OsJmj 

GO  OUlUN  1 | G 1 

i-^hOuj  * G< 1 0O<3  ►— 

UJ  • 

-JITS 

Oi^  • (— cuac*:  -T 

^a.U.(J-*QZ  uj 

_jluZiliz:d 

i—  zcnct  — ii 

l_)  — irrl(—  SI  ~}  • 

GK 

—JOOh- 

U 

OU*  LU'Urvi  • rn 

•F—  • •^OuOwQ.Q. 

4L  II  vQ<2_ 

“5  II  r— < 

II  *1~<1 

II  II  F-  ll 

1-dUU^JHu.izz 

2-<i  II  X X 1 

ii 

^ II  f-w 

II  w 

^-*F— 

II  II 

^F—  — ^ || 

WG^ 

'U.'H  UV/IU. 

U.JLG</?  — JU.U.I/) 

"I^Ui 

ua.'NiNu.^ULUa.u.a. 

a-i/)ju.u. 

ju-GU-  •• 

2.1 

i.  — • a.  O "3  *.  at  st  o x 

iUHZZMUMWHH^2. 

“5  it  *-•  *-H  QC.  G ^ F— 

2.' 

l»l 

>r 

vum 

G 

r»  l^»  aj  tj' r D 

rvj  Ul 

'O  v(j  g 

— * 

'O 

G 

G g 'U'or» 

p» 

2. 

u 

o 


375 


BESI  AVAILABLE  COPY 


IF  INSTATE. GT.l)  MN  = NC  CN ( NST  AT  E - I)  + 1 

ViFITE(6»200I)  NSTATE  M 182 


m 

oo  oo 


o 

co 

>r 


X £ 


r— 

— 

LL. 

•*>o 

— cO 

0 

»-4 

• »— » 

NO  <x 

X 

O 

•» 

1-4  UJ 

— 

UJ 

II  - 

••  — J 

X 

• 

X 

CO 

CO  11 

h- 

LJ 

UJ 

h-  <1 

QL 

CO 

1— X 

<✓) 

LL 

»— • 

<1^ 

< 0 

)— UL 

UJ  h~ 

UJ 

col- 

_J 

CO 

'll 

ix 

LJ 

0 

U-X 

1—  UJ 

r— 

0 

LJ 

<1  0 

UJ 

0 

CJ 

acr— 

0 a 

UJ 

uj-a. 

H Z 

0 

UJ 

mcc 

z 

Q. 

X 

a uj 

X 

<1 

> 

3uj 

LJ  LJ 

•» 

X 

J— 

ZX 

z z 

z 

0 

— 

r— 

<1 

•• 

X 

LL. 

-J 

UJ  J. 

“J 

z 

LJ 

UJ 

<1^ 

LJ  LJ 

»> 

UJ 

LJ 

h— — 

Z 

UJ 

UL 

O 

LJ 

< ••* 

•> 

CD 

UJ 

1 — cO 

X LL 

1— 

CD 

Z 

- UJ 

LJ  cu 

0 

CO 

X 

•» 

»— 

O 

H- 

< 

3 

2. 

xa 

••  LJ 

z 

X 

Z 

2. 

LfV- 

a. 

•» 

II 

CMZ 

CJ 

LL 

V/l 

UJ 

■^uj 

C-J  Z 

X 

• 

X 

• 

Z <4 

•» 

3 

*- 

— * — . 

••  u 

<t 

Q_ 

Q. 

-4>r 

1—  CL 

CO  X 

LL 

O 

CC0J  O 

ZC'  UJ 

•• 

x - 

QfNl  CP 

o—  a 

r-4  •> 

X 

X 

— UJ» 

XQ-Z 

0 z 

•»— ' 

O 

a 

- CQ. 

iinuuma 

Q. 

za  — 

CM  51 

ac 

Z 

oaczaoi— 

h— 

H- 

— O 

QC 

CL 

O — - 

LJ 

Z 

z z 

UJ 

UJ 

•»  •» 

•VI  h-  U-OLJ 

iX 

oa  lj 

U-  — 

CO 

II  — vU 

ZDUh-O 

IX. 

*— 10  — 

JO.  nT 

X 

UJ 

— • 

»Q. 

CO  CO 

— <iz 

3 

0 

- —eg 

u-r-ocO  — 

-J 

UUZ— > U.Z 

>■  ► ► 0 

Z 

CO 

•*CL  r-4  — 

•— ‘H-  OLLi  OLL 

0 

h—  UJU.UJIU 

UJ  —21  r— 

•— < 

CM  < 

n) 

'TLUUJ 

in  <iuoj  uj 

<1 

<*. XLUOX 

Z '-H  •* 

UJ 

X 

— 'U  -+  i t— - 

LJ 

^ — CJO— 

■—  **<M  UJ  C O 

0 X 

0 — 

O 

►o- 

•>  00  00.0 

t>OC  JNC 

h-  MZ  »—  U-  O 

hdh 

‘LL 

♦—CM 

- — ajinuizxzoa 

a 

ZujOZlu 

O •—  *‘Q.<o 

XI 

zz— 

Z 

CL  + O 2Z 

-O 

gC  Z Z 

C— ujp-h  •*a:< 1 

O <3 

0 30 

O 

- < 

•*<  — cm_j  • • 

• CL 

— — • 

Z^l-ZUN\  LP 

O — vP 

L^  — • *™- 

O— 

mr\i  o ♦ »—  O 'K  <0.  1—  r- 

uu 

m *»uj>r  + 

Ow<J.^^v^-J 

O •* 

— X— 

ig 

XO  XU) 

Moocg'vi— 00 

UJ 

ox-jox 

CLiX<IUJCZ<.0  1 

—ox 

— OX  •» 

— O 

ootnz 

Z — ^CJ  • •-) 

• II  X 

00  *CO 

UJ  ^zzza  • 

-(QU\ 

—«om- 

HO 

— *cm— 

' — p—  IJJU-OOJ  OGO  vU^LL.  vO  — 

ZZZJJJJUIL'O' 

tOsjx^ 

•CM^UJO 

• cm 

-V  *-U>  M 

X ||  • r—  UJ  CO  0—0  'J'  ••SOJ  ►N 

UJ 

— UCJCDQJttJOJ  _J  — UJ 

uj  'x  oj  rj  llj  •• 

~>Ow 

2.  vO—  ►<Qioa:-i‘jHvi;^0'Ow 

J 

i— — ►-^^'v.v.v.cr  • 1 

UvOw 

O vO—  1 

OvO 

>— Wf— UJ 

1 iu-t-xi-ooo.-< 

— h- O — »“ 

— 2 

JoOOOZZZZuj> 

•— 'h- 

— * ‘-hO 

^ci— tu<ir>i/)ivi 

O.X 

LJ  UJ  -Q.  rsl  UJ  < CO 

u^^auuuuiij  11  cluj< 

— UJ  II  CMuj 

a.  r-  3;  <t  a.  < t-  a.  "J  2 2 -1 

olujujzlllujz 

xr-X 

H Z»—  x 

Zl- 

UL  ►—  QL  r— 

— 1—  CL  -J 

WU- j 

— — U. 

**Z.LJLJ 

OJXXXXXXh- 

— — UL 

«MULU^ 

^p— 1 

• or— z 

0 — — UUUUZU.XXCLUU.XU.UXXXJ. 

X -X  U.  X 

— Z -X  U.  — • — —•  LJ 

— — LJO-CX  — .XU- 

LJC^JUJ 

u / LJ  LJ  U 0 0 0 — — X — -X  U.  X — -X  u.  — X 

— -X 

•— 

p— • 

— 

— V\I>T 

O LJ 

LJ>r 

UJ 

O 

1>J 

CJ  of"* 

UJ  ‘VJ 

UJ  LJ  U'O 

LP 

O 

O 

O O 

O O 

•— 

O 

O 

f\J  CM 

•o  sO 

CM 

CM 

376 


BEST  AVAILABLE  COPY 


o 

CM 

O 

O 


>» 

<1 

P— 

a. 

UJ 

CO 

• 

INJ 

— i 

p— 

-J 

to 

— 1 *> 

< 

-J 

— « H 

2. 

X 

O 

v; 

I—  •* 

lo-* 

c/)  3 

O 

-JO 

-1  ^ 

U 

<1-4 

LO  » 

P— 

QC'-' 

-1 

UJ  •* 

<!-• 

<✓) 

X- 

C X.w  *> 

►— < «p«* 

ni/) 

QCO  ^ 

vO 

►—4  — * 

<11— 

UJ  • 

QC 

LO  CD 

p-cn 

UJd 

O^  3 

<1  —4 

CLUJ 

2 •*  UJ  •> 

QC.UJ 

oj 

HH-*  P—3 

* 

U.2. 

JL*— • <4.  * 

UJ* 

03 

QC—  P-O 

2 

2 

3 >r  1/  > * 

LJUJ 

QC 

-SO  ►-«  x 

P— 

UJP- 

h-  •*< 

P-< 

CD2 

ZSi  P-X 

00  QC 

2ZUU 

^-2  O - 

min  c 

OOC 

< - H~  CL 

—4^4  LUX 

2 d 

H-— * 2—* 

J»- 

O 

Qi  *”4  * •» 

uu  *-• 

U-iCJ 

UJW  LL  CO 

»-»-  H-  -S 

2 

JL 

2-*-* 

<1 

CL 

h- 

<3  » •. 

aa 

X 

• 

U0|—  CL—* 

coo  •» 

H- 

O' 

UJLO  X * 

— 

••  CM 

UJ 

•• 

NZ*^ZX 

HpJ 

d— « 

d 

d2 

»-.-4  •«  X 

mm^o  •* 

Q<1 

— ' 3*— —CM  •* 

♦ + 

• »Od- 

— 

OCX 

o<— iupu-2: 

OO  +CCOC. 

O 

QCP- 

P-*-^l-2X 

30 

• • —-•LUO 

LU 

LOP— (M«l  * * 

3 

.CL  LL 

UJt— -W  C/) 

• 

d 

3— *3P—  — 4 2_ 

CO_JLUUJLO 

P- 

LULU 

u-Zh^n  » 

— * 

m + + •*  - 

• •»—  — JLU 

O 

-JO 

m— »</)322_ 

“5 

— • -5-5^  c\| 

0 -o<^o 

• 

OJ  cc 

- 2 •*  «*2- 

•» 

•* 

* QC  <3.  LJ 

a. 

cuuj  —2  ► 

rj  mmujuj 

3 -*  * *-x  ac 

U. 

x-» 

*UJ 

h-  ^'—P-P- 

H—  OO~0— 4Q. 

2 

Ol  — « 

— «— jw(\jk  p- «(Mro>r 

< 

<UJ<< 

• • •‘U. 

• 

Q-LLO 

'-h^iuZ<OOOG 

Q-LL 

□n  ilp-oco: 

GD  OO^Zh 

0 

222 

|—  ^ H Lf—  f—  |m  p—  p— 

Q_  3 

aa  -j< 

OCL  P-4r-^  3< 

—r 

X 

•— • O O <t  •— » LO  LO  oO  lO  00 

-4^  2cm<oc  it  ii 

0<M*  * — • 

<x 

— p— 

Za!hP*ZZZZZZ 

^ • 

* *> 

*OJ 

• 

1—  *3 

MOJ^VPW  NXXX 

UJ  ll 

i 

» a.:*.-*  ip  11  — ^ 

'jjanmocxQ 

p4 

ox  02 

32—»<.  — *—404  ro 

CL  DO 

^a.  - *omo 

• 

oir\ 

UJLO  iZ  X ^ 

* II  — 

CL 

02  11  11  -*-*a  cl 

* 2 II  II  i-H.-.fMN* 

h- 

CM^fM 

-c  2 2333333 

3 — “JUJnT  u. 

ll  • "J~7(ju 

0 • — 

vOLULJ 

— IIO3UCUCDCXJCUCDC0 

— < *— « "7  •‘O'-*  2 

OH-  •*•*•*•* 

>-4UJOi-<UJ<f  O'*  •»' 

Or-4  3 •COvU'— H-  (M 

P— — 4— 

- -z 

O —4— (*-4^ 

—1  h-LL'—H-CM 

za 

~P-lo  2 

JIoOV)Z^ZZ<CZ 

It  Q.O'^hO  •» 

11  •rgcM'^w^w 

2 11  •mm<i 

it  O— *a. 

II  UJ<  < :10c 

ai-zzauouoc 

~<l»— h 

- 

UJLU 

r-p—  2 

P-JLUJ  -J 

a.  UJUJ2.2.S:>.4.2. 

>•11  u-^ 

LL 

3'—’  uLr-h-r- 

11  > w w^rHU.* 

>•  2 — 

>•  •— • LL  «J  CL  »— LJ 

UJ  J-2.  J.  J.  J.  J.J.  J. 

UJ  3 3331-*- 

LL'*- 3 3— *<*<*<* 

UJU.UUa.U.LLUCUaiUUU.UJLI.U  ULUJ^. 

3 ••  —*—*3  3 333  3 

233<L3LJ2 

O'— ol-xlclocol.*.:*.— *30— ■•— '-Xllll-x-33— « 

L^LLP-HllLUJ 

'/It— 33333030 

*■4 

2 

U'3 

—4 

CMO) 

>U 

U\SJ 

3 

-U 

<H  ^ 

— CO 

p^ 

O 

2. 

O 

O 

2. 

<N 

CM 

U 

O 

378 


BEST  AVAILABLE  COPY 


o 

cn 

CNJ 

o 


"I 

O 

f— 

O0 

ZL 

^■4 

C-3 

LJ 

r— 

<X. 

CNJ 

o 

Q 

1— 

41 

co 

<*. 

41 

LJ 

•» 

►— 

o 

CO 

h- 

00 

X 

oo 

a: 

00 

u 

a: 

i— 

u 

LJ 

H- 

UJ 

LJ 

UJ 

HM 

> 

UJ 

CJ 

ni 

UJ 

M 

O 

X 

CO 

V— 

*— • 

oo 

oO 

— 3 

2 

"0 

X 

— * 

W 

h- 

0s  LJ 

►— « 

+ 

LJ 

o ~ 

u. 

<\J»-* 

1 

h- 

Is-  lo 

XI 

-IQC 

rO 

00 

H-4 

X 

UJ 

LJin*^ 

l/)—* 

51 

a '— 

►— LJU-I 

1—  * ■«»■« 

►-« 

t—  U>  ^-4  <^J 

X 

<•»—  X 

OO 

3^.w 

+ 

r*-  -h  i t— 

X 

UOH  ►“ 

ZO^l 

II 

OO  •.  i/) 

1— 

►— h-</>0 

*»-0 

►oo 

— *—  CNJ 

04-0  + — .(N51 

.✓W50UJ 

2.  h- 

21 

•— 

«-4**4  ^ 

••CNJ  ^r-4^ 

X 

X^>v  ^ 

-*XOoO 

5.  i/Oi/O 

II-- 

II  CO 

O ^0-4^.-"  + » •.+ 

rsj 

'N. 

X **LJ4l 

•41X 

»«— » 

►— **— 4*— 4»-4 

*— • 

x^xgj  •*  •"►-«►—• 

»—» 

-IQC'JUJ 

4100 

X 

«“4^* 

<“H  X -<J>  CNJ 

X 

#<l  II  1 

•—4  II 

^51  II  It 

*x 

«c\jcg 

l/)  II 

II  il  301*  rg— 

<1 

— 'xXh— ►-«  rsj'—  ^ 

ojojxo+— -~x  4*  it  x • i 

^NN  *HHll  •-*►-•  UJ*"* 

z~+<Vr-4 


It  'J3  (NjUOU  II  +*-•  ♦ • N*J^  irooo  II  ||  -4-  •-• 

h-  u*  II  t— t—  f—  ■—— *0  h— I— r—  p— 

•— *t/)  vU  *— ‘OOi/n/}  »»— «CO'/)in^  — % to  CNJ*-* 

^0(\i  zz^ 


□cu<",-i  41  o *m  r-<oj  ow^  . oo  m i/)c\i^  oj-w^  l i o ow 

<x  »•  it  it  cnj_j>-*x  m juu  M coix  ii  f-m  it  ii  ii  >r  :i  sc<jj  u ljlj51^:  ^x  u 11  it  ujlj  ••  11 

ii.i'-  t-  II  -Jwf—  xh- r-  r—  il  r-  II  »— r— — *— 

UUUU.  ••ishk.V)  _ JLJ**  u-COX^ooxi/jw*"  v/i  JVM/»U-U.u.ur^'  •• 

UUU*-*r^i«i  51ljlj»— 1 ^ ixxxuu 1 5i  51  •-*  lj  *""•  4«— "~*r“ 

4l 
IJU 


umiu 


in 


o 

»>4 


<x 

O I 


2_ 

U 

LJ 


u 

"T 


UtUCJ 

nTU'sU 


U I 


21 

LJ 

o 


379 


Bf$1  AVAUABLt  COPY 


US  KL  = MA  > 0 ( 1 ,Nl-NP  ) 


OOOOOLJ 

oooo 

ouuuu 

o 

ooooo 

oo 

OO 

ooooo 

oouoou 

irtNOi^aocno 

(MCi^m 

r^covno—i 

CM 

cn>or^<JOCT‘ 

—♦CM 

'Tin 

r-GOLPo— • 

>4"  vn>or*ou 

irnmnimn'O 

nU  sU  vO>iJ 

r- 

r»r— r»r»fw 

03  CO 

0303 

03  00  03  O'  CT' 

U'(J'V3>U>U'U' 

oooooo 

oooo 

oouoo 

o 

ooouo 

OO 

OO 

ooooo 

oooooo 

i 

i 

i 

i 

i 

i 

»"  IMNIM4I.  1 

M 

MMMMM 

i .i»h 

i 

i 

i 

i 

i 

i 

vU 

Ol 


CNJO 


o 

UO 


"CM 


»1  X 

II  z X 


in 

-r 


LJ*— < 

O • 


•n 

m 


II  ujx 


CD 

O 


2- 

*• 

INJ 


— z 

OsJ 


cm  eg 

OZZ 


-II  ^UJ 
AC.it  —I— I 


o *fNJ  — * o 

I — 'Xi  ^ CM  ♦— 

Z • 

o *Q(M 

OCO-2 

_J  LL  <!  II 

2.  — I—  • — I — IZ-^r-l— I — !•-<  **Hit 

X o I wU-  -~w#  -4  — 

3L  II  f— « • Hi  «G.  + Q.*cr  • I I 'J'-f  tu'  IO 

”v.  o-nx  *■  uj*-*r-  lu»^  *-»■*■  i.j  n ro 

— OX  + _jQ.<rtZ'— Cl.^»0  4-UJCv|:Q'--«'-'CQ*-<<MCM— I 

— ILU  ■*-  r-4*.  fNJUJ  *2H  ^ _J  ic:-j 


z 

— X 


II 


II 


XCM  — 


ZX 

X<<N  •* 

a-  ft- 

I li  csj  «fr  | 

II  XXYO  II 

-I  *-*r-4 

U.-J-?  -»•  + «•  LL  -) 

Z — + 0 XZ 

CNZ  •— «uj *.•-«*..  cvjuj  *2H  *uj»— *uj ^ it-J  Z Z r-aj  ^^2.  CO 

I O'' if—  n»H-+  '--la  vyi— «►-  f—  X'M  (_J  U II  rnr—  2.  ^ ||  m 

it  m it  it  li  n <^3  — ♦ It  *—^L  <4.  •»  <1  II  Z i»  II  l—  II  li  h-  II  il  It  II  —*<l  li  II  ** 

nr-  t—  n h—  ii  w w wf—  r ii'-  x r—  ti  n x 

0*^1  XXUVI  XVI  vx.  *“4"  VJL.  U.  V)U_V)X.  *-»-  IM  LU  »— I — • aj  03  UJ » V X <lu  V ; X^UJ 

a.  A.  JL  LJ  ^ a.  i O i.  a.  —I  -I  •-•' •"»  •-»  -4  •“«  •-*  -i.  JL  ~ X _ J O — J O —»  X.  a.  a.  Z.  LJ  ^ Z Z — * Z 2.  LJ 


U> 

"t 


vV 

ni 


l'* 


BBT  AVAILABLE  COPY 


380 


I STATE!  MX) 


O 

0 

r- 4 

t— 4 

'•V 

O — 

0-5 

C\Jw 

O 

O 

OK 

Uh 

4 

i-tO 

3: 

U 

-J 

a 

O 

II 

0 11 

O H 

_» 

— J 

— «-j 

0 o_j 

*■*  m 

• ■— » 

O'  •— » 

0 <r 

CJO 

0 r-4  CJO 

O 

v-  — « 

ajh~ 

co  aji— 

^4 

i/> 

•V/ 

— < u • v> 

«\J 

-1  CJ 

4 

»-  — _J 

I 

h- 

xrg 

0 xog 

O 

-H  — « CM 

— 

l 

X *— 

v-  0 x •— * 

t— 

Z 

O O 

►—O 

0 —0 

II  ~ 21  II  II 

f—  O 

5t— ' 

0 -l  Z“5t- 

O 

XV/  —4  r-4 

— 1 X 

X 

2.— VI 

LJ  — * 2.-*V> 

O 

♦ 1^1  — 

2I-J  ^4  — ^4—1 

II  — » 

0_j 

H II  x^4  0«J 

XX  <->  x X 

■fr  Q.  Z II  l»  — * 

II  CO 

m 

II  H-Q. 

-*  < II  ^ CL 

— * 

<SX>-IX<X< 

cr*-^^n+  • + 1 <t- 

~*0— *0 

OlM 

1—4 

J+^*ItU  l/l«H 

-J 

a.  * <x  2.  <i  i. 

•PI  I—  rf)—  — 1 

t— 

“7-1  • 

U4 

• ^ “J-J.  • 

UJ  • r—4 

— 1 

+ uj ~*ra Of vj Q.  ^ 

+ «>o 

— — UJ  -t-  IDCJ  jC 

uj  a.  uj  ujo 

-J  — J •X*-*  >-  —2 

c\|w^z 

z 

Ot_l_l 

Zirst-Oi  OQJ 

ZIU 

1—2-  II  II  ^ II  t— 

X *0  CD  LJf\|  ||  rr»  -4 

rtcsj 

* 

-jr»o  • _j»-< 

• (T)  • U JOO  •—I*-"1  • II 

<£  II  <l  <3.  »» 

-Jt—  It  —I  II  II  >— <0  0 II 

h 00  11 

11 

— »2--J 

1— 

iO  »•  11  1—  (\ZJ 

f-*. 

r—  11  X xr— Xh- 

II  — * r—  xr—  M 

h—  r— 

11 

II 

11  r— w II  <«**•#  11  ^wx 

yy  i *4.  x<4Vi<4,  vi*-* 

u.UOja-vv4a.vjvj<iv>_; 

^VJWUL 

X 

UO.U. 

VU.^V<U.4U  UU.U. 

UU.  «l 

-JO 

UJ 

cr»  v m u * 

0 

0 0 

V-J 

IM 

pi  >r  >r 

ut 

'Ll 

l— 

uj  m 

0 

•— « 

^-4  ^4 

<—4 

l\4 

BtSf  AVAILABLE  COPY 


381 


MlC3(l<i  ) 
GC  TO  22C 
MX  = K 1 


— * 

XX 

*-« 

ruj 

X 

z 

-f 

-JUJ 

•X^ 

<MO 

04 

OX 

\M 

0 

*— UJ 

X. 

0 

t/)Q C 

1 

(/> 

X 

2 

*■*  «• 

z 

mi- 

•> 

<0 

0— • 

0 

0 

i-x 

K— 

OO.-* 

0 

t/> 

z 

X 

7 

-1  ♦ LL 

< 

U 

2: 

> 

+ — • 

cl  a a 
z z ^ 


11  11  » 11  — * 

M M *— I #— • || 


O 

0 

*— « 

*-4 

»— • 

-* 

mo 

H- 

II 

1 0 — 

— » 

1 ♦— 

*** 

w 

*-H 

— *m 

C/> 

-T 

T'O— * 

— 1 

«4 

cm 

O 

<r 

cm 

—1 

xo 

^rsjoo  1 

1 

O 

3 

3 

vy 

3 

0 

CL 

ar- 

H 

CM  ►— 1 

•— I 

h- 

t— 

►— 

1— 

1— 

h-U 

*— « 

Z>^> 

CL 

+ 0 — 

w 

OVUZ 

cO 

LO 

c n 

00 

tn 

»— 

• 

O 

21 

i-o<r 

nT 

►—ar  cl 

z 

X 

X 

X 

a 

X 1— 

•JJ  CL 

0 

•» 

— f-O 

*D 

^ z) 

W 

— » 

*■* 

"X* 

00 

s:  0 

actus:  + 1— 

i.  - 

X 

>— <o  h- 

ZWK 

O 

•»  « 

1^1  | 

(/) 

*X 

1 

zroum 

CO 

iLU 

"*■  - 

^ <“*  — 

**•*» — 

-*  - 

^ZxJZ 

r-< 

* ox 

X 

11  Ha.^UtMUn^VJ'J'UUTU 

»— 

•“* 

O-J  •* 

— * 

LJ 

L(NJ- 

OOOOOOOOOO 

X— * 

II  II  X 

•<o  II 

1 *-t 

II  ‘-J 

X^* 

x^<-o—  11 

II 

— »ULJ— * 

OOOOOOOOOO 

• • 

1 w 

>— *-«w 

ft 

X 

0 

Om(J  O 

O ^ Uj  O ro  0 rn  O rn  c»  t rr>  cn  rn 

OJUJ 

-J  — IM 

'-jP-O'"" 

1 • 

10.0 

O ^ 

1 X. 

| X • • — MJ 

*“• 

'Uai/)  • 

^ m 

*>  «k 

*»  *• 

»>  ^ 

**  r> 

30-J-J  *~-*x-4h- 

x • »x 

3 -J  >rr\jv/>  <•— j;>r  • *■ 

II  XX  ||  «MU^  11  •—  3-J 

ww  r— w «-*  11  r—  w 1 

-ZULU.  AUVIU.LLLL  •*  VMU. 

X'-**-‘a.C-lX;*-»X*~«»~— *X*— •»■ 


- + -f  — « •-«  *-*i— jo«0v0'0'J'0^'0 

7 O ^X2.-*Z:3UJw  w 

^ • • «sJ*LJ  >T  CJ<Mh-  • LUCUUJ  UJUJLL  UJUJLUUJ 

1\J  II  II  II  •-•-JOI— Op-O  Xr— I— I— r-H- r—H-P-l-'P- 

I 11  11  11  it  It  1—  P— 

LJ  ^(\|  *-*U.U-i/)LJV;L^/  ••  U.  UL  UL  IX  cx.  u.  QC  UL  tz.  ufc. 


J-LX5tX-JX^ 


z 

X 

L-»V-» 

OU 

UJ 

CJ 

O 

O 

UUJ 

-^«\j 

>rm 

Ju 

L> 

I'* 

CZJ 

LP  *_ 

CM  (\l 

CM  CM 

Z 

CM 

CM 

CM 

CM2. 

a 

LJ 

0 

O 

r 1*  i" 

!.  u 


: '. .-  r 


• . V 

• ui  *L. 


'■  ')py 

^•vJg  s 


on 

< 


o 

I— 


f— 

<1 

0 

f— 

0 

to 

1— 

2 

► UJ 

CO 

— « i— 

i— 

*X  *4. 

CO 

w t— 

-J 

<r  o> 

CL 

0 — 

►— « 

H~  •* 

to  H- 

LU 

Z UJ 

0 

•*  h- 

2 

— z 

<i 

—4  ► 

J- 

w LX 

to 

m a. 

0 •* 

i—  a. 

X 

• ^ 

to  a 

-•  ^ 

— * 

0 

—! 

h- 

•—4  *> 

+ f 

► 

o') 

OsJ 

m 

-J 

— 4 LULL 

X 

II 

— t-*: 

— * 

X — « 

□ 

M 

2 

C\J<1  - 

—•CL 

— 2 

h- 

*> 

u 

OV—  — < 

•—2. 

II  #-x  » 

— 

•— « 

►— 'OLL 

•—  «k 

w— / 

0 

*— * 

on 

—to-?  2 

LUO 

— rjjw 

O 

2 

^>2  •*  •* 

KZO 

xi— 0 

CO— •"'-  — ***"• 

LU 

2 •— ^2  lu 

-%<l  — * 

<X2 

— » 

h— • — • • — — 

a. 

•>  h- 

*— •►—  w 

— 

*xio*xr\jm>r  - - 

•—1 

Q.^w^^pgrn^  <1 

t-wi^oc 

-<02 

2 

JUUOO'JO- 

0 

J-UJZUIOOOOU!l 

•-5 

21 

1 — 1 — 1 — 1 — 0 

— IUJ 

2Z— •*—  ►L-t—  (—  r-1—  t—  </->-* 

1— 1—  I— 

CT  + 

w 

oQtOtOoOoOOO^x 

(X 

O UD  < — 1 l/)  4/X/1  LO  (/)  </)  Q. 

z<  + s:a 

LU+  — 

0 

— 

— ■*• 

ChKZZZZ^-'^NZ 

H — O 

• — (\;f— 

xitxio-  • • • • • m 

m ► 

JI/)V)N\NNS\  V/)  — 

-4L/IO)  | 

-J  — t/)UZ  0; 

OSLO  •*•*•*•*-  — 

ox 

2^*^— *c\jr^oci:“:u- 

CL  "J  J-  — 

♦.MX*— » 

0 

O^OHXXXXX  •* 

00 

UJ 

2T  *1-0 

• 

m CO  CM  (\j  f\J  (Ni  (\J  CNJ  x 

-4—*^ 

1 * Z * 

LU*-  'J'JX 

►\J  •‘NN  ^ VN 

►N 

^ooT3ajaucucijLijajajr-- 

•1  O O 

" i-Ol-rz 

l « 

r^^vsxwvwiyj 

O 0—1  | LUO 

«J  — «t/)UO 

• 

*-c0^»— H-l— *“l— 2 2 J^VIZZ^Z^^ZZIZ  >^Z  • 0»-xf-  ZZ/5Z 

LU2LU<^<<I<l<KcL.— JUJ<  ||  ti.  CZ2QOLJOOOLJO  '•  If  2—1  II  'Oil  X 2. 

y-  r i.  — > f—  a.  o cr.ujujzi.'Jii.i.ii.i.^.  n n —*11  w i?  c\j~?  11  11 1 


— « II  •— nxauLa  ULUt  Ltr-  II  *-«u.'Uf—  U LO  O)  II  o»  ’—O')  ^ « 


UL  CJLLJC. JtULJt— MJUUJ  LLU<UJ^.  •UUUIUUUUV-J'-UXUUX  u.  X^UU.Xi'J^.U. 


iX^XXLLU-XXXX- l-S. 

t4_*xuLLU 

i/>uuuuuuuuuuz<:xuzxjmjxuhjx2«*-' 

-*cvji<  I'TUA'U  CO 

0 

HI 

-x  rvj 

r)U!JrjUUU 

-X 

O 

OCOOOOO 

m 

O 

-nmcnm'-onirn 

X 

8B1  WMIABIE  COPY 


383 


AD-A046  469 


UNCLASSIFIED 


NAVAL  P0ST6RADUATE  SCHOOL  MONTEREY  CALIF  F/G  12/1 

NUMERICAL  METHODS  FOR  SOLUTION  OF  QUEUING-NETWORK  PROBLEMS  WITH— ETC (U) 
SEP  77  6 R HUMFELD 


C-C  TG  S 

NX  = N$TC3(K2  + 1)  - 1 
If (LHS.NE.LSTGIMX  I)  GC  TC 


oooooo 

rc|'TO»-«<NJCO 

mmmrnmro 

oooooo 


• X 

• o 

UJ  INJ 
CJ  •» 

— • o 

tO  •— » 


-IwX 
(UUJP^ 
OH—  ^ 
CX<m 
Q.  h—  — 
vi  •* 
O- 


•*  * 


LJOO'O  — X 

— 

CM 

P> 

u 

O ►O*-*  II  ro 

— * 

*■■4 

o 

—i 

-J 

X c\J  •— 

w 

o 

a 

*UJ 

CN 

I — 

i— 

m •‘••X  — H* 

O 

►— < 

— 

o mm— < 

H* 

LJ 

— O 

•* 

o:zu\ujk 

CO 

to 

O 

o 

ct 

r» 

U — ^1—  to 

— 

1 

>r  a 

— 

vO  C£  </)0<X 

O' 

^■—^4 

— * 

— 

'-I  ac 

•* 

QC  — H**- 

•» 

cn 

4^ 

— ■ 

«■» 

CX 

U> 

— 

O UJ  Hmi/)U 

oo 

QC 

ZL 

HX 

O UJ 

—4 

f—  - X ►—ex 

O 

X 

z 

J — » 

(\j  - o-  '—a. 

— 

to 

h- 

W 

♦ — 

OsJ  - 

•4* 

v.o  x — • 

2TO 

UJ 

— o 

o 

\o  X 

O 

— O— o—a:  II  — •* 

t— 1 

O 

ct 

XI- 

Xh- 

—0—0 

*—* 

— 

x c\ix 

1 

•i-Vi 

ZV) 

X cj  — 

vs  » 

i.— o^o  ^oo 

o 

— o 

— X 

— X 

Z — 'OX. 

o 

<L 

ZO^OXOOH 

►— 

«-H  • 

h- 

•f  xinvinoams 

to 

• 

• 

OUJ 

OUJ 

+ ZtfVs. 

to 

•f 

• -■'V  ► — _J  ►*'V 

—J 

tOJ 

o 1 

H- -C. 

ni 

rn 

1 

<t  ^ 

UJ 

to  • 

rjU)  • 

1 — 

—c/i 

IZ — 1 ■!—  -l-OZV)M  1-t  •-.  17H 

ZtOX 

to  — 

— 2! 

|w  *12J<LLI<  tU<I 

<xX 

U O UK 

o 

iiu  ii.o-  •tu<ox  a 

LJ  i 

■ — l—i-l—i.  n ID—i 

II  w»— iQr— UL.LU  — UL.  N— w 

II  l-  »i-  II  ZO  II 

~*r- 

4C.  II 

II  x 
— II 

1-  II  X 
— II 

r-  — *i— Zr-X  n r—  H 1—  il 

II  '-'—LI.  — | 

II  il  '-'•-'(X  — u.iu  — ll.  — — ’ — r-  — ^-'11  it  ii  u.  — ►— LJ 

lj  u-u.ua.uuu.uw^u.Au<iui/)ii.ajiy)u.x<.a.  uau.  lj  u.a.uuu.Au4Uvmj^ 
i— i vj  — — ^ a„  jl  u.  — jt  u-  ^ u.  — a.  o i.  o *£ — at  ^ — a.  a.  — — lj  — — o — — -*  u-  o — a.  o z o uc.  wu 


m 

>r 

pun— 

CM 

Mjr*  tv  y\ 

o — 

PI 

O 'Till 

>(j  I'- 

o 

o 

LJ 

— — 

— 

pH 

O — — 

o 

o 

o 

o 

in 

m 

vn 

in 

BEST  AVAILABLE  COPY 


SICPOUTINE  PI6IN1  ,I\2,K)  XJ010 


r 


OOi-H 

<->o 

o 

GUUOUOOOO 

ooo 

-HCM 

in 

vorwaoo'CJ*-Hrsjro>r 

u>or^ 

UOU 

oo 

o 

C’JUOHHHHH 

hhh 

ooo 

oo 

o 

ooo ooo ooo 

ooo 

xxx 

oo 

o 

UUUUUUUOU 

ooo 

UJ 


LO 


o 

<1 


to 


CL 

u 

LL 


CO 

2 


<1 

O 

LU 


1 1 I 

zu. 

CLU 

-»o 
<0 
aj  •. 


1 1 1 r-4 

x— 

t-x 


UJ 

oo 

rvl 

too 

2 

2 

UJ2 

c 

J>— • X 

►— « 

X 

«J  ► UJ 

1— 

UJ 

o—  o 

< 

CJ 

00-1  2 

CL 

in 

2 

*— • 

00  ^ LU 

x; 

*-4 

UJ  2 ► 

o r— 

W 

2 

20  LU 

O LU  *“« 

u 

IX 

2C 

MU  1—  2 

UJ  1-  1 h- 

H- 

■* 

-Jh-2LL  < OQ_ 

1 — < -J 

— 

-<<\| 

h-  O 

UG  ►UJ H-  o 

< C UJ  K—  UJ  O 

O 

XM 

2 

UJ  V. 

OOO— QUO  ZUJ 

H"  O UJKOO  QO 

O 

Z2 

+ •> 

CL  (\J— » 

^liHUZO-NN 

</)  H-<20  •-•in 

2 — 

(JQJ’^>*NNLJ,h 

— 2 — <ir-  ►*«•  uj  ► 

2 IX 

i\J2 

— » **o 

□ o-iu^a^  j 

—4  ► —X  ►-LO 

—4 

-H^X 

J.UJ 

— 

O-H  1 

UJOO 

'-OfNjO-J.O  002  -«  1 

— * 

O 

o 

• 2 

2 ^JJJJM 

2 • *2  • 9~4  Zw  II  ^ »>l  II 

2 

♦ 2 • 

II  O 

t 

o ir  — 

*-«  oo  o aj  uj  uj  ai  >— 

O'—*  II  HuhU  N V U.OJV#  O 

OJ 

OH* 

♦— » 

UJ  *■ 

x\v  'x—* 

o o-j  + XOO— • 0 2 • 

o 

nXoOON  4- 

•0^2 

Z It  !-•  II  Z • If  l • • II  II  < o — <z 

iz  • 

•z 

Z i— ir\|  —>ix- 

ukzujoowo  z ~5  — oo 

-•O  ZO  o 

II 

X— ■ o 

CL  ujXXXX 

II  — *CU— * H 2—  II  — *—*  — • II  II 

II 

1-  II  II  X 

II  II 

— ii  r— o 

UJ  4.2.4.4.J. 

II  —4  •— • II  ||  II  — • 

II  w 

ii  ii 

«g 

t*»W  UJ2 

— ' ••  ^UUVJU  •• 

u--^  2 u^^muQLZX 

OJ2  AO. 

o 

•~*OX  CJLUJ 

uir— oooooi— 

■Jj-o-uaJ-^u.  4a.uuuao.huuji.AM04^^ 

uuv 

2 2 

2 

—I 

UJ  UJ 

•J'  <uj 

CVJ 

m >r 

a.  2 

X 

2 3L 

X 

u o 

o 

o o 

o oo 

385 


ouuoouo  oo  oouooooooouou  OOUOOOOUOOUOOUOUUOUOOUO 

aoa'0*-^c\ir^>r  coa'O^cNjr'ivj'^Jr^-coLPO^  rsjrn>rm'>ur-ao<-r*o^tNjm'TU'\sor^-<»cr'0^cNj^>r 

rvjrvj  c\iojn)n)mmmrnmmn)^r'T  >r>r>r>r'T>J’'T>rminu>inmuunuwur\sO'0'00'0 

ooooooo  OO  OOOOOOOOOOOOO  OOOOUOOUOOUOOUOUUOOOOO'1 

UUUUUfJ'J  OO  OOOOOOOOOOOOO  OOOOOOOOOOOOOOOOOOOOOOO 


o 

0 

< 

*—♦ 

h~ 

h- 

UJ 

Of-I 

0 

< 

O 

h- 

2 

a. 

— • 

UJ 

UJ 

rr> 

u 

o 

O 

O 

0 

iH 

O 1 

• 

r-r^ 

O 

-Z 

cc 

* 

o 

UJ 

UJ 

0 

— O 

o 

oo 

O 

> 

I- 

Q.CN 

ao 

o • 

l-h 

0 

<r 

2 

<r 

—H 

K 

• 

UJ 

0 

UUJ 

<N 

+ 0 

oo 

in 

> 

0 

Or- 

f— 

O 

•</) 

— H 

oo 

• 

z 

< 

a 

h— 

H-lQ 

w 

UJ 

a 

aco  O 

— f- 

h- 

-50 

CL 

*— — * 

ozu 

uj2—  • 

UJUQ 

2 — 0 

QZ» 

2 

• •» 

LULU 

• 

•» 

• ^o*-« 

1-2 

0 x 

X 2ll 

-1  02-5 

x z 

r^ct 

CL 

I-*- 

>r 

— • •* 

— 

<5 

O 210 

2 nu 

•— » 

2 O - 

l\JOJ 

UJ 

<l<i 

■*  OX 

r4X  «V  4 

r-z.-* 

► • 

•*  <cu-* 

O 4 — ^.IL 

*•  'Z 

■*  • 

►— r— 

* OO 

OU'MUJ 

ooz“) 

^onio 

r-<«— 1 i-OCT' 

• -zzuj 

« Oi 

* -4 

ujco 

00-* 

OHH|-  X 

Z ^ 

<N 

oxhi:  u 

ox 

X 

ZilH 

• rg-v. 

CN^vUj^q.2: 

• 11  a. 

• (|  11  it 

11  ^ -5 11 11  • 

• 11  0 

II  + -5  II  II 

• <l 

«*o  • • 

0 

►"»— «UJ  *v.  •*— * 

r— 

0 

■*■  UJ 

N «■  U-f~ 

■* 

UJUJ  4.  (N^o— * 

— V70000  tuj-i")-* 

-jzox-jxzoujcn* 

• < II  oo 

* 

2—*-  2'-' 

• • 

•~4 

2-<  —5  • 

2- 2.^0  • O 

Z — -5 

* oo  • #»-OG£uj*a.o*-«uj<x  ii  in  uwx  uzno  o ^vr 

Ullh  If  —*•— h-UJ»— 3Lf— f— f— II  II  ^.u.^u.11^11  II  HU.J.  II  II  II  <CH  II  t\|  II  II  U.P-* 

■w  II  H-»WW  II  W*— .IX.  4HU.UL  II  ^ II  WUJ  UJ  UJ'-'  l»  -■»  II  UJ 

u-ULU  a.'-U.  U.  U“-(IUUUllUUX,^  u uu  LLU'JU^U^^.UUW-^.^^.  U,0  ^.0^.4*.00 


a > o in 
•4J 


P*  O O "H 

0^*0-* 

o a 

IN  (N 


i\j  oi  sr 


&BT  AVAILABLE  COP' 


uoouoououu 

m vjr^  a><T*0'-*C\jrri'T 

'U'O'O'O'Or-r-p-r-c- 

oooooooooo 


ooo  UOOOOUOUUOOUOUOOUOOUOUUOUOOUOO 

h(njp)  rn'Or-  coo'  UHcgm  >j*m  >or-ao  u'o-**''Jrr>'J’ur\'<jr-cou'0^cv4fn'T 

oou  *>j<njc\ji\j<\j  <\j  mm  cm  mro 

ooo  uooooQnouooooooooooooooooooaoo 


ouooooouuo 


0.0.0.  Q.u.Q.a.a.a.o.a.Q.o.o.Q.o.Q.Q.u.a.o.o.a.o.u.a.ULa.Q.o.o.a.u. 


au 

< 

CD 

O 

a. 


<1 

r— 

co 


c/j 

LU 

I— 

<L 

LO 

> 

O 

<x 


X 

2. 


O 

■— i 

II 


U^UUUUUQ,  UL  UJ 


CT*0> 


i\#*rr»i 

IVrfCNJtNJ 


uj 

1/) 

w 

UL 

CL 

a 

•» 

+ 

LU 

— 0 

”3 

X 

“3 

— » 

— * 

ino 

w 

1- 

— >o 

W 

un-^ 

Lf>  —* 

•» 

•» 

*> 

•»  •> 

a 

V/) 

— * 

•*  •> 

X 

X 

X 

-■>0 

in 

wLL 

►— 

2 

.-4*0 

m 

X 

X 

2 

^ O' 

0 

LLUJ 

2 

•» 

II  II 

0 

II 

II 

II 

II  II 

0 

LULJ 

">“3 

0 

—> 

"3 

-3 

-3-3 

m 

L JLJ 

QC 

II 

•»  •» 

m 

•» 

* 

*> 

O 

CL 

X -> 

— »■— * 

•» 

— * 

— * 

>0 

II 

i.  *> 

-3-3  CO 

0 

-3 

“3 

-3 

“3-3 

•W» 

LU 

► •— < — ^ 

WM 

W 

UJ 

—* 

UJ 

2 

4C  “1 

UL  LL  2d  LJ 

UJ 

Q- 

UL 

UL 

Q.u.r— 

r- 

H- 

*— 1 

2 0 — 

•*  *»Q1  h” 

h- 

UL 

•* 

•» 

•» 

»•  •. 

.—4  >*H 

”3w 

<. 

Q-l- 

- I-CL 

“)“)D 

»— « <r 

•» 

r~o 

—y 

”3 

-3-50 

LU  • 

■—UL 

*-3 

“3  ~ 

^—1-0 

aC  •■ 

■— 

’O 

^0 

UL  LU 

X —5  c/1 

20 

•»  n 

LUO 

3:m 

LUO 

2'»2i_} 

jC'jtHZn.O'' 

— — » CL  ^ 

**• 

•»— » 

— * «■ 

L-KJ 

•■'J. 

UL  UJ 

'-'NV  LJ 

CM  — -Ul 

m 

mm 

rn 

ni 

OI>f  U-IU1 

u>r^j 

UJ 

•— <LU*-H—«» 

30  *-«LL— *0 

uo*^u  **^u>  — < 

rn 

>r 

OOU  **^0 

0 -3 

UJUO 

^ iCOO 

OOOUZ-C^-- 1 

0 

-^UJ 

0 

0 

OQUZZ  — 

11  *-« 

II  O H — 

2 

rfc-J— l-*m 

m 

+ 

m 

•O 

CL 

»— • cX)  LJ  CLJ  OJ  • •* 

► *•  • • LJ 

1 UJ  » 

•> 

•» 

•» 

•>  » • LJ 

1 UJ 

\.v,ajvy 

nOOCJLUO 

J 1 O 

■0 

X.  | 0 

0 

'UvQLUuJ 

0 1 

->uj 

• H ^ 

OX<Z>22U>— '2 

w^.aJUJi-2  • —z 

-Z1  —2 

2 

-z 

'022  • 

— .aO^Orr,  ul 

CE-2(_KJ  »UJ1XLUUJ  • ♦ 

x2luulujix 

2LULtUJ£XUJCtUJUJ  • 

xz 

LL“?*- 

ix  CM— J 

UL 

ih— ►— II 

H X-^r-3 

I—  -J 

11  ^1—  J3h-  -J 

ir-t-2  II 

11  2 2 

UU«^ 

II  ||  “7f-LJ 

JJ 

*~«r— 

— '-•1- 

— *1- 

»-*r— 

— r — 

-J  'UCJU.U.LUa.U.U.0.^:  AU.U.U.iXJU.UJA>i.C£.U^a.UJ<XUjaLJLU.4l  AO.U. 

V/ I »—  (J CJ L-» +*  -C  LL.  3:  — • •—  2L  -S  LL  JK  rx  a. -*  IT.  J6  oc.  -*  LL  i -C  »-•  ^ *.  •-» •-* 

UJ  *“•  04  r»)  ut  ^4)  00 


o 

o 


best  available  cif 


387 


1C  fc  FITE  <6 ,30  15)  N , P ( N ) 


ououuouoouoouoouoooouoououoounou  CJ 
mn»rnroo)vr>j,Nr>r>r>x>T'r>r'T«'^w'ur\uiuiu,ur>uun'^'0'0'0'0'OMj  >u 

oooouooooooouoouooooooooouooyooo  o 

CLQ.ULU.a.u.Q.Q.c^a.a.Q.Q^Q.u.Q.txa.Q.a-Q.u.u.Q.u.ci.Q.u.Q.u.u.a.  a. 


UJ 

.> 

vu— — 

UJ 

• 'O'O 

•* 

^CNJCNjHJHJ 

LJ 

UJ^H^  • • — 

UJ 

MJJUJlNiCNi^U 

P— 

• •*  • 

• - UJUJ  CM 

►-* 

II  •* 

QC. 

(1  II  - - UJ 

Q- 

► 

II  II  - 

UJ 

CL 

<1 

II 

rvj  o»  -r  at  u uHiMni'rm'UominnM(t>u>uMn^ 

_4  ^ O UOUOUOO^-H'NIM'T^^^'^ 

^ oouoooouooooougH 
m ^irnr^irn  rr>rnm^)rn^)(T)rnr<)mm(,Ti 


BGI  AVAILABLE  COPY 

388 


X* 


OJO 


<L  • 
lU' 
•it 
X * 
•CO 
-lit 
• • 
CMP*- 
—Jit 
• • 
— «vO 


m 

•it-i 

oy  •*. 

o 

»— • nJ*  • 

• 

sO 

LJ^OC 

men 

CN 

^ **- 

H 

N 

•mx 

CJO 

U 

3*  * 

fH 

+ 

►—  • 

t— 

Q-  -3 

Q. 

— * 

o 

LJCNJQ- 

— <\J 

LJ'— » 

m 

a 

*:CJ 

cl  2: 

-*z 

o* 

o> 

• •^ 

CL  * 

z • 

* 

u — < 

UJ  —4  • 

•CL 

r— 

t— 

— % 

t-*X 

UJ 

CL*  *-« 

O-X 

O-^ 

CL 

l_J 

i 

CN 

< -X 

►— 

CL-*  -4 

-«-4X^ 

OUJ 

X 

t— 

a 

• 

I—*:  • 

< 

Z^  + CL 

wO  o 

ir\t— 

z 

o — 

UJ 

00  *0 

ct 

-4*  + Q- 

+ +OZ 

vT< 

1 

•* 

X 

zz 

Z-J-ICL'x 

-4— iCNJZr^ 

Z— • ^ 

-40 

*HX 

'N.  •<*' 

v< 

1 u. 

’“,(\l*-«x  IN 

Ujvyj 

4t 

u. 

X *-* 

— J-^ 

^*-*1— u.oc  z?rvj 

O-f  »-0 

-JZ 

• 

z II 

< +• 

it*-H  II 

it  ►Zi'^a. 

CL 

+ -4  ^ • 

• wh- 

—J 

o 

x m 

H ^ 

-ix  •-iju  + at  + -f  t + it  «*o 

LUI—^- 

<4. 

*— * 

Oil* 

• XU>  1 + 

II  UJ-* 

cui:  — jcuro 

<Z. 

U>«-  •***  II 

mr-<i* 

P“ 

ZOJOJ 

t— « 

UJLP- 

* r—  *-«» 

N»-<VNC£(M 

— • <f>  'OP^OO^rg  M — 

z 

X 

II 

0N^»-HCO*-4Os4 

n>UJ 

^PvJit  II  — *n<\|<OJt—  X II  — »<wC\J3 

z.  •t-.czuj.^  ii  xx^itit itit*:  *-«»~»-4<n»—  -J-zr-  »i  ^ ii  ii  <o  uj  • — i i — » k-uj  z 

OJCLZLJLJVjJ  II  It  ||  W II  0011.  II  20  X Q-OsJt-LjX  |l  vO00t-O*-» 

i-O  •i.a.Ui  II  •■«  II  It  II  II  II  II  II  II  — «U_  II  II  _j  II  „ju>  II  LJ <3. t— i.  II  II  ||  ll  1\J»— *<ll— H- 

i.  uj  <4.^  ii  vua  cl»— ' ii  i—  r-  — • x wr-  ^ 

„iMn>>rut'4j»—cytj»«-Hi— i*-*oJLJh-r—  ulP—  r-r— r—  viyu  Jtiluvjuu.  J. 

<->•— it  ititititita' itituioj*t.^.*-'.^.^:zz4£2:^  — i*-*— a i— tito»-*-«vjLj 

•-trsj 

•-4  ui  IN  u\  'O 

— • c\j  rvj 


389 


3tST  AVAILABLE  COPY 


+ 


CL 

X 

•» 

O 

Q_ 

O 


O 

CL 

o 


1 

H 

2 

»■ 

o 

o 

X 

X 


Z — 

—4 

*— < —4 

z 

m 

| 

X CL 

•» 

0 

z 

a 

nco 

— » 

— » 

I — ' 

00 

O 

r— 

O 

UJ 

0 — * 

z 

O 

+ 

•— < 

— h-p- 

—4  , «— ■ 

(X 

•» 

of— 

O 

•* 

—4  <1—4 

♦ 

X 

O 

t— « 

X 

a.  h— 

XI  1 — 

O 

O 

W 

Z LOO 

+ <N 

-•X 

f— 

O 

Q. 

Q 

w ip— 

+ x 

U 

—4 

O 

a. 

— rx 

O 

LU-4  — f 

X^XI- 

K 

ex 

0 

X 

0-*  1 

+ — • z 

X 

f-z,-4  Z<\JZ  + Q 

— XOXLO 

— 41L 

Z 

(X 

•> 

f-Z 

0 « •■ 

<1  ••  * 0 

0— 

CX  UJ 

•» 

z 

-I4C  r-4 

II 

SC  — <sc  ^ 

II 

f— -4 11  —*x  11  0—1 

wmrg  *«•**— 

ZO 

•fr 

2. 

>— iuja.1— ii/>  >-«  + 

00  X 

CNJO^rorn 

—•O 

Q-*— • 

X 

•f  w— « II 

•OUQ2  + ''  II 

>■1^ 

• II  — » -f-  -*o  0 

ohhoa« 

-*UJ  II 

Z^- 

+ 

O 

"JOlNJf—  «ZZ  Uh 

“JCJ  •— 1 II  *-*■*!.  | » 

(\jf—v/cor—r— <✓>»——* 

II  LU 

0 

Zh-  + *-* 

| JU 

11  *.f— o>— 

1 W 

H 1 »— 

-4vr'^ZZvu/)Z<X 

*-4f— 

Hi 

X00 

UJX. 

• II 

it  *-»cr>h- 

UJ 

x.  iuZ  ujX  -JQ^h 

Z ZZ' 

-•-a : 

< ♦ ♦ 

II  l\J 

II  If 

Z O 

ii  "JO 

m 

IM 


ex  ZZPsJ^t-ZZOf-  — «*-  • II  O fl  II  CX</W  —I  CD  I— 0—1 

<3.  hH^jOU  H rr»  <4.  — «<L  II  -4<l  ||  II  -J  II  U h-  II  II  ||  II  »-«iX^O  | «<rv>XZ 

11  *—  11  wwu-*— •>—  11  11  ii  f—  11  11  r-  r—  XX  uf  11  uj  n 11  11  — • II  11 

S/I  uu-U.UUX3t  O </)  UV/2.UV)^IMU.^  ACU^^iAi.CiUflOJUU  II  UA 

* *-4  2.  o »-•' ^ z z »-»« *-•  2,  ">  o x j u •-•  x o *-•  -j  o »-i  z a.  x o a.  2:  *-»  x x u.  a.  o a.  x x ui  z z z 


rsj 

o> 


VM 

>r 


BEST  AVAILABLE  COPY 


390 


I 


SNdM  WH)  r)3D0  = ( ftvl)  J 3 D 3 


0- 

O' 

CL 

nT 

+ 

z 

a 

■» 

u 

— «• 

X 

1- 

CD 

>r 

II 

X 

in 

O on 

on 

I on 

on 

on 

on  o 

on 

on 

-T 

W 

a_  d 

Z 

— z 

z 

z 

Z'-I  o 

z 

z 

in 

U- 

o 

r* 

a. 

LLCO 

CD  Q_ 

LL 

u. 

u-m 

U- 

U- 

LU 

1— 

>r 

— ♦ 

♦ 'T 

a.  ♦ 

** 

♦ 

^ — 

♦ 

+ 

o 

LJ 

■—4  ^ 

a 

— • 

— o — 

— * 

<—» 

y— 

o 

CJ 

o 

• a- 

-*a.O 

wx 

X 

a. 

IH  • 

a. 

a: 

4- 

o 

H- 

am 

0-ih 

•-x 

X 

X 

X o 

a. 

ai 

o 

— • 

UJCL^ 

CL  — 

<-* 

w 

LU 

o 

»— 4 

*-* 

f\l 

o 

CO  • ZU. 

2110 

»—  LL 

U- 

LL 

U-O  • 

LL 

LL 

*** 

— 1 

o 

•i-  — * -*■  UJ 

•*  UU 

O/LU 

UJ 

UJ 

UJ  .J*-* 

UJ 

UJ 

*■— 

LL  O 

< 

X. 

-“5CJOJ 

LJLJ 

— «LJ 

LJ 

U 

LJ^»  •»*-* 

CJ 

LJ 

1— 

•» 

UJ  • 

r~ 

•> 

XU— 

"-O 

30 

LU 

0-J<3.— 

O 

o 

z 

<1 

oo 

z 

<1 

CJ 

a lu  + n 

*•110 

♦ ii 

CL  II 

II 

ii  • 2:  uj 

•1 

II 

• 

X 

OHU  • 

a. 

• 

ii  h-cj— 

CJ  — • 

O—l 

IJJO-"‘^«'''*LJ— ‘CJ^-UJ  II  h-  CJ 

LUC-i— : 

3 — 

UJ  *— 4 

II 

II  — I- 

LU'- 

» »i 

OJi 

r— 4 , 

-i^cg^-j  t- 

H- 4 — 

o 

n 

uu. 


•4*  K^J.I  + ZJ+tZ^  + S.1  I 4-X  + i • I-  4-  +zti  + i.+  «0 
aDsO</)C\|w  | rcj^»  • 03 >T ^ •— in ^(NjaO^CJ*^ CD O^QOU^'O^'^ */!</> 
^•-•iCiL-tac.ii.a.a.itu.r— i£u.zz  Jc.u.ZLL.a.u>»-»a.*— a.r— idu.idu.^z 

W If  UJ  II  II  LU'-»  II  II  UJZ.  II  UJ  II  II  II  LJJ  II  LUW  ^ II  ||  ^ II  UJ  II  UJ  II  ^ II  II 


c\jrc  w^*-oo 


iG^iO-*-AU«ii.uUAua.a-Au< 


'or— 

'T'T 


-'UULLJLL.LJLJLJLJi-LJa-LJ^'U-^l.aJLJUJLJLJ'— U- 

,U*-'U»-.2.U4.UAUi.U^^'«,iUaLUU^« 


rci  cD 

JCU\ JL 

II  II 
^LLJOO 

*.oa. 


U'LJ-— 


rvj 

u> 


BEST.  AVAILABLE  COPY 


391 


j 


CCEF (1) =CCEF ( I) +CCEF ( MB  ) 
52  C C EF ( MB ) = 0. C 
hm  = NT*L  + MALC 
54  IF  (MN-MM22  ,25,25 


• x 

— 

LL- 

II 

XC/) 

LL 

UJ 

H-X 

Z1X 

X 

0-3 

CL<£ 

M 

-LX 

— 

— 

— 

— 

— 

H“X 

XHH 

'V, 

XX 

JK 

— 

— 

— 

— 

— 

CO- 

XX 

»M 

CM 

<M 

CM 

CM 

— i — 

acco 

— i 

—4 

—4 

—4 

—4 

OCX 

X— • 

— 

•k 

— 

— 

•* 

«— >r 

h-QL 

— 

m 

— 

m 

— 

VI  in 

• »— 

X 

C — » 

u 

X 

X 

4-4 

-VI 

IS) 

U) 

yji 

OO 

VI 

CJ- 

X • 

—4 

»— 4 

—4 

—4 

—4 

• 1— 

>00 

a 

CJ 

O 

o 

o 

»z 

4’- 

XUJ 

\ - 

F— 

►— 

1— 

h- 

F— 

>ou 

\x 

— 

<1 

<L 

<1 

<1 

<L 

'TOC 

«o  ^ 

— 

• 

m 

• 

w 

NUJ 

• 

— 

•» 

— 

— 

— 

XO. 

LU 

X 

X 

X 

X 

X 

f-J’Nk 

2- 

vU 

•o 

o 

vU 

>o 

• •> 

UJ  ^ 

—i 

w 

w 

w 

— * 

1— X 

•— 

F- 

CM 

o 

'f 

in 

o 

— 

N. 

• i— 

•> 

— 

— 

•» 

•» 

• ^ 

CL  •* 

X 

— 

m 

• 

- 

m 

—4 

• 

11  CL 

o 

oO 

CD 

LO 

<S) 

00 

O OC 

— 

aj 

cu 

X 

OJ 

X 

+ 

LU 

oOX 

— 

LJ 

LJ 

u 

u 

o 

U.X 

OJ 

X 

~7 

o 

o 

o 

O 

a. 

XLL 

r- 

u_ 

XX 

”5 

— 

m 

- 

- 

- 

w 

LU 

UJ 

— 

•k 

— 

— 

— 

— 

o 

a:- 

IL 

oo 

X 

X 

X 

X 

X 

x 

ucn 

CD 

PI 

o 

o 

o 

+ 

X 

a 

X. 

V. 

>* 

«•* 

<r 

a:  \ 

o 

— 

— 

— 

— 

— 

o 

wn 

UJ  - 

m 

— 

• 

m 

H 

N 

J3uOO 

• 

X 

X 

X 

X 

X 

UJ  v 

— 2.  CO 

•k 

2. 

2. 

2: 

3: 

2- 

• 

X 

«■%»  « 

i—  1 -4 

— —4 

— 

— * 

Q.LO 

HZ  O 

O 

<NI- 

OH- 

vTh- 

LT\H- 

'JH 

LU 

LL  • — * LO 

— 

— 

— 

— 

— 

O'  » 

U. 

<CL 

Ujm  LL  LU  X 

• 

HU. 

Hit 

-*x 

r—X 

— *X 

iH 

UJ 

<a 

LJ^  «UJ(jMO 

<r  f- 

II  u 

ii  x 

ii  a 

LJ  II  LJ 

II  X 

X II 

X 

H- H- 

UUJ  — «X<  <1 

co  ^ 

—4 

ao— * 

»— 

CP  4— 

—4 

1-4-4 

1 X 

• 

- - -X  CL  O LU 

- UJ 

- 

— -9* 

— 

1 + 

-H- 

2TX  AJ  ►'Ll- 

O o 

— •• 

vQHIW 

— *• 

O*— i* 

— 4» 

a-> 

— » 

X<I 

z-o  — o>  »*- 

CO  CL 

W *• 

CQ  — * — 

— * «k 

COw  - 

w — 

a— 

•—4 

^ — 

-*  - "J  <x< 

- UJ 

X 

- X 

X 

- X 

X 

IO— 

*'4*  F— ■“ * — in 

CM  — CL 

— >o 

in— >o 

— s3 

a—O 

—o 

— k 

*— ilux^oj* 

X.  — — • <1  (\J  -U1C/J 

UJCM- 

uum-^ 

•U— ' 

X<JU— ' 

Cpw 

l^X 

liZUJX'VXX 

2-llo  •*  ttoxsco 

UJ  - 

UJfNJ 

COO 

uj>r 

xm 

CO  sO 

• CP 

1 *X 

-LLJ  OX  HOOSU 

— OX 

o - 

— o •* 

o - 

— o » 

o - 

h—  O 

— ix-*^  uh>t\i 

^x 

vT^X 

hX 

vOr-^X 

—*  X 

X^H 

. II  II 

»-\U.r 

II  X -LA  II  •'NN 

—4  1 — I^NJ 

1 »*UJ  c\j 

1 1 -CO  CM 

-COCM 

1 I -CO  CM 

1 — UC\1 

1 • - 

\ ^-4^* 

NOwU 

— 4— 4-£  vO^^'O-NU. 

I ivO— 0^  ^o—'lp'O'— *lp— *>o 

—4 

Wf-  CL 

1 .<1—  (-  + —!  — (-  -OLJ 

a'-H 

— I— 

— H- 

•X  ^-H- 

w|— 

0.W 

;ow 

UJ<.atl_JO  — l'-*a.UJ<I2'»UJ<  • H 

II  Q-LU<I.CJUj<10Q.aJ<0ULi<LJQ.UJ<0uJ<0CLaJ 

,U'U.HZai» 

^ I—  a.  i—  I-  2.  i—  kl »—  3!  F-  h*  i.  H- 

^.H-a.1— 

1-2:1— 

-dh- 

IjJMU-  L-U  •> 

o II  II  UP— ILL.  ||  UJ— «UL— IUJ  II 

U.^>  ILL 

— a. 

— *-»gl 

-HU. 

w— Hi 

»— UL 

1 4 

,XX<XX.i_ 

II  H CXXXXLK.XUJUJ^. 

r-u.a:uuuLuua-u.uucruuu.a.uuiiUUu-a. 

■XX-*LL  -J'U 

UL2.UU-<U.4.U^U.  ►a.LXMilLOJCU.U 

— >u.vjAu.OM^u.cyjsu.u 

—•  A 

— 4CAJ 

XO 

O 

— • tM 

IMIM 

Pirn 

'Tinai 

D MJ 

p*  00  UJ 

U'U' 

X 

lUJCP 

o 

CJUJ  CJ 

'jj  aj 

xco 

cuuju J 

XCD 

ujujuj 

UJUJ 

IP 

o 

o o 

O 

o 

o 

O 

o 

0 

^ 4 

r— 4 .—4 

*—4 

r— 4 

f— 4 

*™4 

BEST  AVAILABLE  COPY 


lose  F CF M AT  18X»7  (6X , ' % CF  TI*E')/3X,'  JOBS • , 7 ( 6 X , • AT  DISC',  12)/) 
GC  10  <52 

51  W F IT  E ( 6 » 1QS 1 ) ( I* 1 — 1,8)  , . , , „ , , , 

10S1  FCFI'ATI6X,8(6X,'«  CF  TIME')/3X,'  JC eS • , 8 < 6 X , • A T CISC',  I 2 I / I 

52  IF(KTrt)  60,61,62 


X 

oj 

<> 

OJ 


C/) 

CO 

a 


U 


OJ 

u. 


X 

o 

< 

LU 


l/T 

-J 

CO 


X 

II 


vO 

t 

XfO 

X-i 

»vtlJ 


LL 

a 

cc. 

UJ 

(X) 

X 

X 


o 


o 

oo 


X 

OJ 

<1 


^CL 
jC 
X.  tt  u 
II  »i  X 
<*.*L«* 
xxxx 


A 

XX  Q 

•* 

z 

II  CM  ►-« 

UL 

—• 

X 

’ h~ 

o 

X 

►00  3 

w 

OL 

-*  ••  CD 

H- 

u. 

LU 

'O 

•— —• 

UJ 

a 

O' 

wCO  cc 

UJ 

a 

o 

0J 

LLUJ  V— 

^0P 

0J 

oj 

OP 

* 

0J 

ULJOii  0O 

ao  op 

QC 

“5 

i— 

o< o — * 

•» 

LU 

•* 

O 

0J0CO  Q 

rno 

a. 

-o 

H- 

o 

UJ*Hit» 

CO  1— 

X 

O 

> ► ► 

•» 

•* 

X 

OX 

•w 

-*<3.oj— x 

(MO 

-►X 

<4. 

m 

0JX 

a. 

—* 

•— «>r  — uuih 

OKJ 

X 

o 

•*o 

•jj 

X 

1 O -HO 

0J 

•» 

-IO 

* 

X 

^OX  ►O'N 

-*»— » 

0JV. 

HH 

CL  *-< 

uxo 

OJ 

• 

<MCM 

1 II 

u>  •* 

• It  *t  r- 

it 

UJ  LU 

a.  ^NW'  ►X 

1 • 

-*>T 

<— **T  ►'V. 

iZ^ 

X.vU 

»—  X— »-«CP 

— — <-0 

x Ow 

O-I CJ 

+ OP 

+ CPsO^ 

• X 

P-JO  X + 

X.  + 

•z 

+ 

CLUJ 

•— 1 

<M  «— H- 

r^-^p<uj 

1 *tf\^XOH 

^ z ••a.  <t  uj  <i  a:  aj  <i  - 

II  a.  • 

ron>^tojuj<l 

II  V'  I 

l “5 uMi. a.,—  + u-i. a. >— a-a-t— o 

-tX 

it  it  11  •— 

OX3t  II  *— »—  X 

•—i  l|  • wu  II  JL  UJ  II  II  II  I-4U.WI— .LU/;ULWw(\|  II  II  ^ ||  It  II  X *—li. 

^oj  ii  jvu.  ii  vjl. lj \_j lj  ii  u^u.UA.^u.ua.au'^^u.u.  n *q^vu4.«i^<iuau 
a_ui  i4.^4.'-'uui.'J4.uAMU4A^u.Mjcu.u^*-"-'x^aLa.oa.a.a.iu. 


OJ 

vU 


<J* 


in 

OP 


4J 


nT  OilM 
OJ  OPCJ 
O O 


OP 

OP 


WU 

~*o 


®EST  AVAILABLt  COPY 


KIP 


LJUI 


'"J 

^U. 

LJLJ 
►— « 

h— OJ 

3L  — 


-V) 
LCD 
oo  o 
1-4  OJ  “5 


— 

LJLJ 

a: 

XO(M 

X 

H 

► 

CDILUJ 

H 

KJQ. 

w 

— 

x >- 

LU 

— » 

U M_Uf— 

*— 

vO 

(MLL* 

<4 

• 

► 

— 

U. 

CO 

v.»— x 

O 

■Jf 

—4 

v*  >r 

x 

lii 

- X •* 

*— • 

H 

► 

»-o- 

LL. 

Cl 

X 

<00 

LU 

a_ 

CM 

QCUJCD 

LJ 

-w 

LJ 

LJ 

— — ■» 

i 

OLL  ~3 

► 

XMJ 

»— « 

► 

O 

— 

— 

X • 

o 

Q.  —« 

UJ 

UJ 

►CO 

LL 

— t 

(X 

X 

X 

<*-4 

OJ 

xro 

UJiUUJ 

— 

2.UJ 

LJ 

an 

aoo. 

LL  — <1  CO  O 

LL  — <02 

II  ►— 

LJ 

►UJ 

ctx> 

UJ  — XXX 

UJ— 2IX 

MX- 

+ 

< ► 

Dh 

O'Owww 

U'O^'- 

•*<N>D 

zx 

2T- 

O •LL.LLLL. 

O • LL  LL 

— * w t 

X 

II  r-4 

► 

►COUJ  LULU 

►CO  LULU 

>— *curO 

a. 

p— « ► 

OOQX 

-HUUU 

— r-4l_JLJ 

0*,-4 

" •> 

zr- 

<LUOOO 

<1  LLILJ  LJ 

u.xaj 

CM 

— L- 

3<  •* 

X ►*»  * * 

CO  X ►■*  -B- 

OJ-H  *<\J 

*-"3 

• 

— >*333 

^4  ^ X-J-5 

O 0-XO 

JJ 

— CL 

Q-oO-J 

^4 

LL  CM 

►H  LL  CM 

<r 

»— 

u_x 

CD** 

UJ^f  ♦ + 

LU—»  f -f 

uj 

< 

UJO 

OLJI— 

+ 

OJ  o» 

O LJ  CM 

► 

► ►ooo 

01 

LJ  ZD 

• 30 

o ►— — — 

1-  LJ  0*^— 

ro 

X-  ►>- 

•> 

UU 

► f— 

— • 

► X— 4 CM  CO 

— * ►x^rg 

CO 

iUJX 

— lX 

XLL- 

CM 

OOOvJ^^- 

o^-jcmww 

•» 

Q-fOO 

Xhh 

X 

COO  ► 

H 

rO  3!  ►U-LLLL 

► ►LLIL 

cm 

— >-  -o 

.*■%*— 

-^in  x 

► 

►O  ►—  nTUJ  ujlli 

Q— >TUJL1J 

jj 

*-T^r—  >T 

^LL 

LU- 

LP^OLf^ 

*->4 

^h  # *— i LJ  ►— i LJ  LJ  LJ 

— X *-<*-•  LJLJ 

l O - ►—•  — 

<UJ 

O ► 

QJ  V.UJ  ► 

4C. 

CJ  f-4  HJUOH 

HH  Q H »»LJLJ^* 

— 

HQ  ► ^ fH 

xcj 

OXOVU. 

II  II  DX 

3;  11  ox 

t\J 
— < | 
— H 

>*  a 
• no, 
cu  ^ 


u_<-ix  x • 

u. 


-h  ii  o 

CJ*-*  II 


CJ  II  HO  II  II  II  + + ♦ *-4  • 

4l  *-•  *-H  ►'T  »— 


X^o 

^)OJ 

»C)«— • — vU1— '— — — < 330 

+ — *1—  I—  • -f  + <f  re)*—  + '-►I— — 'K—  Q»-»r^^h-^f\|fOi.2-3L 


o II  II  ♦ 
• •*>T 

j < 

• '-•(MX 


>t'j,'raj«3:xxa;oo^j.iu<uj<j«  'lu<^— oh^lu<-w 

xX-*-xxxl-^hllxi—XI—x<i  ► ii  ii  n u ^u-^h-xu-u-u.  n ii  n <— «h-XLLu_  n 

w ii  ii  ii  ii  -ill  ii  •<  M tu  II  *-h ii. >-*4 U,|—  x ii  uj  •— laujuiuj  ii  w i— iu-ujuj 

a.4.^^AU.UHiU.4.AiUUUAU.U'J-UUH<;ujuU  UUUUlUUUi-'^aJU  u.uauuu<i 

►ncg 


rHr^CM 

CM 

Ol 

au 

LT* 

LJ 

O 

— H 

nO 

uoo 

LJ 

LJ 

O 

LJ 

►H 

H 

“H 

HOO 

^H 

—4 

O 

CJ 

O 

H 

O 

pH 

>—4 

•H 

«—* 

H 

avaimbie  copy 


394 


<1<J u * 

tu  mx 


I— LU- 

itr, 
jCQOLi 
•— O 


•yji/) 

o*  *g 

cu3 

CLUJ 

cnuti 

- > 


LJ  ^ 
CC.X 
U_  LL)  <r 
LJ  CD  •* 

z> 


— * 

lU^CD 

— 

CD  O 

vO 

2IU--5 

• 

JU 

O 

m 

-<C  -4 

•* 

<1 

LJO 

UJ 

UL  O UJ 

UJ 

2.  • 

0^0. 

2. 

*— m— »— * 

— * 

X 

— 

x^<o 

< 

—eg 

ZDK 

X 

ujlus:  2. 

21 

rr)  — 

003- 

X 

0 **- — 

— 

*00 

*-«»— ' - 

0 

UXU.LL 

LL 

>H  *> 

►—XX 

0 

LU 

11  x 

3»-xt 

* 

— r-HLJO 

— LJ 

HH  >H 

C0</)  * 

<x  *00 

<l-*0 

•>  •» 

«-4*-MJ) 

<1 

m 2: 0 -fr  * 

2.0*» 

— • 

(HU. 

2. 

— < *-  «-o“) 

^ »~5 

CO 

♦—  LL 

>— n- 

m 

u.  m 

ul  m 

'-'UJ 

•— 4 

VIUJ 

IL(M 

eg 

UJ-4  4 4 

UJfH  4 

xo 

*-»^:o 

OUJ  ‘ 

LJ  LJ  LU 

LJUJ 

UJ  <1 

— a <3. 

•LJ 

«> 

►“  LJ  •— *- - 

LJ  •»— * 

OX 

O 

— X XX 

OOO 

eg 

eg  <.x^m 

— X p-4 

LJUJ 

i— 

4 CO  OO 

*♦- 

eg 

OZ-)vf^ 

Z-5-4-  — 

*-> 

coo  in  sj-x 

II  "5 

— « 

O - **U-X 

•*  **u_ 

<1 

O 

2 2 - *cu 

^ O 

•» 

Q-— >TUJLU 

Q — vT  UJ 

— * ■ • 

0 

**——* X X * 

•-O  O— ‘O 

—4 

— ‘i-Cg—* LJLJ 

i.  rn»— *LJ 

>T  * 

u.— 

*Hu-tr\r*'Ux 

f— « < LJ 

eg 

-H  — 4 O *4  •‘OO—*^ 

—«  —4  »*LJ  •— 4 

»-<x 

2.0  — U. 

— H 

0*£-*-4*-* 

<-H  f-4 

2.  II  O-* 

II  O*. 

or* 

£1X1.  II  uowm 

II  OOO. 

4 4 lO  • ^hO  II  II  4 4 — ♦ 4 hO  II  4*  ‘CT* 

4-— X 

| 

11  \ 2: 

— 4 

^H>—  *— < •»'T 

•*x.4-j 

u.  • 1 

t-4  *^LJ»  -* 

O 

I 

• 

t 

• 

VJU 

CU4'-*— 4— J 'O'-'-*— ><LJ  4-  IM  'O—'— < *4  sUw^oOuJtlJ 

4 O'— “OX^GOLTLe 

—H 

-HhvOiA J 4 

'-•'■oaiaL 

— 1—  uj- 

mi-.2:_j— 0 

1 2: 

Ljr\j-^uj<t 

-4LLJ<*- 

-3tU< 

0 • 

r-4LJUJ<  x CQUJ 

* uj  •“?<! 

M II  ZHKIU-l  II  II 

11  -^i— a_u-  11 

1-2-  n 

II  ^ It  r-4  .— 2.LJ2-_J  II  II  II 

II 

•HU.  II  — >►— 

X 11 

•I  W *— < UL  UJLLJ 

II  •— *OL  UJ 

11 

II  *■* 

II  *-4«w  -J LJ 

||  UJ  W t-H  w II 

UJ  LJ  LJ  U-  LJ  U.  LJ  LJ  LJ  <1  LJ 

LJ  LJ  JL  LJ  LJ  <4 

U-LJ<ILJ  U-UJLJ  (XL  1 UJ— L — * 

UJCULT 

UUUU.U.LL 

U-<1 

^-“>-*>0*— ‘LJJfcU.LJLJ2.i- 

?2-LJ-*U-LJ2.~3-*X2.2.0*— »2.LJLJ_*ILU.»  - 

X X 2.  at.  -7LJ  LJ  2:  — • -*  •-•  “0 

*-•2: 

-"X('l 

IX  01  IX 

>r  u>  rn 

4j  >r 

r*uucn 

VJ'  LJ 

— * 

M •—  »H 

•”4  — H »-H 

—4  tM 

vg 

*-4  LJ 

— 4 — * n 

*-«  0 

HHQ 

—4  —4 

l-H 

^■4 

•—4 

«— 4 

>*4 

' BEST  AVAILABLE  COPY 


H 


JLX 

r—m 


UOL 


OX 


-0* 
OJ  •* 
*-«X 
aim 
h- in 

CO^v 

— oco 


cm 


^3 
>o  a. 
•*o 
x 

—p  OsJUJ 

UJ  rnx 


<x 

a: 


cm 


rrjaj 

•ho 


— » 

— » 

U_  LLI  *— « 

«a 

CD 

-*UJ 

• 

i. 

i. 

rOLJ  XCC 

m 

'■O 

hO  OsJUJ 

H 

LL 

UL 

•»</) 

UJ 

UJ 

UJ 

II  + - 

•> 

LJ 

u 

»—  a: 

X 

O 

LJ 

LJ 

— ~ 30 

— * 

< 

CM 

* 

•* 

* 

— ‘O  Q-LL. 

GO 

'O 

2T 

v0 

"5 

o 

*5 

'—a.  x o 

<M 

• 

w 

m 

nj 

CM 

'-'LJ  OO  rn 

PI 

a. 

*H 

UJ 

+ 

H 

u.  •* 

H 

UJ 

P) 

O 

•» 

CU.-I  LJ*-* 

O 

UJ 

O-' 

pH 

< 

— * 

m 

a 

O'-*  OL  H*  o 

c— 

O •« 

0-5 

•» 

O 

CL 

nj 

CM 

i— 

m 

LjUJ  Im  H- 

— * 

•*x 

-X 

CP 

»■ 

IU 

h 

'-H-OI— < 

< a 

->m 

3— - 

CM 

“5 

o> 

u. 

O - 

CL- 

oo 

CL- 

<  • 3:  o 

z o 

CL 

-H 

< 

UJ 

• >r 

UJ 

•o 

UJ 

-^a:— * » — 

— «r 

^*UJ 

— * 

LJ 

OCM 

LJ 

CJ 

— *CJ 

sr*  'uxviv 

CL.  — * 

r— •— • 

I^LJ 

VJ' 

r* 

uu  •* 

o 

•H 

HU 

*-«— » CD  • — 

LU— «—«Q_ 

H «k 

^O 

«-U^H<M 

H 

phx 

II 

'I  Q 

21 

O-^O'^OUJ^ 

o 2; 

ox 

O* 

O 

om 

ii  m — . 

♦ II  'O 

i.  1 

0+  + • 

— im 

HH^H 

«f 

pH 

^jin 

*M 

• 

U. 

rsj  »*u_  •— «lu 

UJ 

•k 

— • 

•• 

a 

<-H  <1  ^ CD  — — • CO  h-  O UJ  — 

mj^cl  h- o m 

Ot.2<j 

vO'—O  +vj  + +<CQZO'OOsO*- 

SE.  | 

2- CM 

Z-jrom 

• ii  • 

'-h  • 

■w 

is  1 • 

'-p 

•—1—2: 

a— co 

—a 

w • 

LJw 

Cujljwj^  U-  a. 

OO  COOLUCO  3tUO“3 

CQ— iLUOujCa. 

IL*— U-i.  II  U-r— U-  “3  II 

CL 

1— 1—  HlQCUi  II  ll 

II  ll  i_ 

>-2; 

1— 

II  II 

1— 

►-SZO 

UJ 

LUw 

UJ 

Ujw 

II  UJ 

►h  II  •— 'ULUJ  w 

II  II  w 

II  HU.  II 

II  Hi  M II 

<W  || 

*— « 

II  *-»uLI— LJ 

OOLJULCULJLJLJU.CJ 

uua.  liuajtfviL  coj 

LXJ  <3.  u_ 

QL  LJ 

UL 

<iaju. 

CL 

CLLJCU^L 

UUUM 

i-LJLJW'-'i.LJCJLJ-^LJ-CU-S:- 

J -ft  LL  LJ 

-?j:lj-7 

2.2.»-»LJ-«0-CCLCLUJ 

•HIM 

OJIM^r 

UIMJ 

r-  >o 

UJ 

r» 

CP 

O 

HtU 

IM'MIM 

cnjim 

IM  *H 

IM 

IM 

P> 

O «-< 


pH  -HQJ 


396 


Copy 


o 


APPENDIX  G 


GLOSSAfiY  CF  dAJOP  VASIAOLE  NAdES  IN  THE  TH3EE  PflOG  SA.dS 


ALFA  A matrix  used  to  store  the  branching  probabilities. 

ALFA(i,j)  is  tae  probability  that  a type-i  job  will 
route  to  PPj  when  it  completes  service  at  tne  CFU. 
ALFA  is  input. 

CCEF  A vector  used  to  store  the  positive  values  of  the 
coefficient  matrix.  COEF(i)  is  the  coefficient 
corresponding  to  state  INDEX(i)  in  tne  j-tn  balance 
eguaticn  if  NCON(j-l)  ♦ 1 < 1 < NCON(j).  Ine  values 
are  given  to  COE?,  INDEX  and  NCON  in  the  main 
routine.  After  the  steady-state  iistribution  has 
been  determined,  some  of  the  locations  in  COE?  are 
used  in  subroutine  ACCUtl  to  accumulate  the  measures 
of  system  effectiveness. 

CPU  NPt  ♦ 1;  the  total  number  or  processors.  Processor 
CPU  is  the  central  server. 

IAS  An  errcr-indication  variable.  Its  value  is  checked 
to  abort  the  problem  if  an  unfixable  error  is 
detected  in  the  input  or  dimensions. 

INDEX  A vector  used  to  store  tne  state  number  of  the  terras 
in  the  balance  equations.  See  COEF. 

IFcAL  An  optional  print  indicator.  Setting  IP3AL  = 1 will 
cause  the  balance  eguations  to  be  printed. 
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IPLSTG  A dimension  indicator 
the  dimension  of  LSTG 


IPLSTG  should  be  set  equal  to 
As  LSTG  is  being  filled  in, 
IPLSTG  is  tested  to  see  that  storage  does  not  tafce 
place  beyond  the  dimension  of  LSTG. 

IPPHOB  An  optional  print  indicator.  Setting  IPPHOB  = 1 will 
cause  the  steady-state  probabilities  to  be  printed. 
Only  the  first  1000  will  be  printed  if  NSTATE  > 1000. 

IPSTAT  An  optional  print  indicator.  Setting  IP5TAT  = 1 will 
cause  the  vector  representation  and  state  number  for 
each  state  to  be  printed. 

IP1  A dimension  indicator  for  NSTG1  and  NSTG2.  Performs 
for  these  vectors  what  IPLSTG  does  for  LSTG. 

IPS  A dimension  indicator  for  NSTS3.  See  IPLSTG. 

I P 4 A dimension  indicator  for  NSTG4  and  XSTG.  See 

IPISTG. 


1ST  AT  E Vector  representation  for  the  left-hand  side  of  the 
balance  equations.  As  tne  i-th  oalance  equation  is 
being  generated,  ISTATS  contains  the  ISTATS  vector 
representation  of  the  i-th  state. 

1 1 E 3 A running  variaole  which  indicates  the  currant 
problem  number.  See  NPH03. 

JSIATE  Vector  representation  for  the  right-hand  side  of  the 


balance  equations.  As  the  i-th  oalance  equation  is 
using  generated,  JSTATE  contains,  in  succession,  the 
ISTATE  vector  representation  of  state  INDEX  (j),  wnen 


KS1G  Victor  used  for  storage  of  the  right  subvectors. 

LSI G Vector  used  for  storage  of  tne  left  subvectors. 

ilP  Number  cf  servers  at  the  CPU  (tapes  model  only).  MP 

is  input. 

N N 1 ♦ N2;  the  total  number  of  jobs  in  the  system. 

NCCN  A pointer  vector.  NCON  (i)  points  to  the  end  of  tho 

i-th  talance  equation  in  C02F  and  INDEX.  See  CCEF. 

NCt U The  number  of  jobs  at  the  CPU. 

NDIG  N - NCPU;  the  number  of  jobs  at  the  PP's. 

i« C C 0 E F A dimension  indicator  for  COSF  and  INDEX.  See 
IPLSTG. 

NCE  A dimension  indicator  for  P and  NCON.  See  IPLSIG. 

NFE  The  number  of  PP's.  NPP  is  input. 

NFnCB  Tne  number  cf  problems  to  oe  attempted  at  the  current 
run.  NPflOB  is  input. 

NE 1 N ♦ 1 . See  N. 

NP2  N ♦ 2.  See  N. 

NS I ATE  Number  of  states.  After  the  states  have  been 

generated  the  first  time,  NSTATE  is  the  total  number 
or  states.  Prior  to  that  time,  NSTATE  is  tae  number 
of  states  generated  up  to  that  time. 
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NS'IGI  A pointer  vector.  NSTGl(i)  is  the  location  in  KSTG 
or  the  first  right  subvector  whose  elements  sum  to  i 


NS1G2 

NSTG3 

NSTG4 

I 

NTCT 

[ MZCOEF 

N 1 

N 2 

? 

RATE 


A pointer  vector.  Use  varies  with  program. 

A pointer  vector.  Use  vanes  with  program. 

A pointer  vector.  Use  varies  with  program. 

N ♦ NEF;  the  length  of  the  ISTATE  vector 
representation  of  a state. 

Number  of  nonzero  elements  in  the  coefficient  matrix. 
NZCOEr  is  the  length  of  COEF. 

Number  of  type-one  jobs.  H 1 is  input. 

Numoer  of  type-two  jobs.  N2  is  input. 

A vector  used  to  store  the  state  probabilities. 

A matrix  used  to  store  the  service  rates.  UATE(i,j) 
is  the  rate  for  type-i  jobs  at  processor  j.  3AIE  is 
input . 
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